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(57) A data transmission apparatus for relaying data 
transmitted from the transmitting end in units of packets, 
each packet having additional information relating to its 
sequence number, priority, and data reproduction time, 
comprises: a receiving unit for receiving packets trans- 
mitted from the transmitting end; a priority decision unit 
for deciding the priority of each of the received packets; 
a retransmission packet storage unit for storing packets 
the priorities of which are equal to or higher than a pre- 
determined value, as retransmission packets, on the 
basis of the priority of each packet decided by the prior- 
ity decision unit; a retransmission instruction receiving 
unit for receiving a retransmission request from a termi- 
nal at the receiving end; a retransmission decision unit 
for deciding whether retransmission of the packet for 
which the retransmission request has been made 
should be performed or not, on the basis of the retrans- 
mission request and the storage status of the retrans- 
mission packets in the retransmission packet storage 
unit; a transmission queue management unit for setting 
the transmission order of the received packets and the 
packets which have been decided as packets to be 
retransmitted, on the basis of additional information 
which is given to each packet; and a transmission unit 
for transmitting the data of these packets in the trans- 
mission order set by the management unit. Therefore, 
the transmission quality in a radio section in real-time 
transmission is improved and, further, the number of 



retransmission times is reduced. 
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Description 

FIELD OF THE INVENTION 

[0001] The present invention relates to data trans- 
mission methods, data transmission apparatuses, data 
receiving apparatuses, and a packet data structure and, 
more particularly, to a process of performing data trans- 
mission in packet units between a distribution server 
and a terminal while successively reproducing the data 
of received packets at the terminal. 

BACKGROUND OF THE INVENTION 

[0002] For transmission of video (audio and video) 
data on the Internet, a download type transmission 
method and a stream type transmission method are cur- 
rently employed. 

[0003] In the download type transmission method, a 
video file transmitted from a distribution server is once 
copied at the terminal and, thereafter, data of the video 
file (video data) is reproduced. So, the terminal cannot 
perform data reproduction until the file transmission is 
completed. Therefore, the download type transmission 
method is not suitable for long-hours reproduction of 
video data or the like. 

[0004] On the other hand, in the stream type trans- 
mission method, while video data or the like is transmit- 
ted from a distribution server to a terminal, received 
data is reproduced at the terminal. 
[0005] Recently, a stream type transmission 
method using a protocol called RTP (Real-time Trans- 
port Protocol) which is defined in IETE RFC 1889, has 
mainly been used. 

[0006] Figure 28(a) is a diagram for explaining a 
video data transmission method according to the RTP 
[0007] With reference to figure 28(a), a distribution 
server (transmitting end) and a terminal (receiving end) 
such as a personal computer are connected by a cable 
in the Internet, such as modem, ISDN, or LAN, and 
transmission of video data is carried out between the 
server and the terminal by using the RTP. 
[0008] In the data transmission according to the 
RTP, processes for the respective packets are synchro- 
nized between the transmitting end and the receiving 
end by using time stamps as time information, and 
asynchronous (late arrival) packets and packets 
affected by transmission errors are discarded at the 
receiving end. Further, discarded or lost packets are 
detected at the receiving end, according to the absence 
of sequence numbers given to these packets. 
[0009] On the other hand, Internet applications uti- 
lizing mobile phones, for example, mail access and text 
information service, are advancing now, and infrastruc- 
ture for high-speed radio data communication (high- 
speed packet communication of -384kbps) is under 
preparation for practical use of the third generation 
mobile communication (W-CDMA: Wide band-Code 



Division Multiple Access). 

[0010] Figure 28(b) is a diagram illustrating a com- 
munication network for the above-described W-CDMA 
visual terminal. 

5 [0011] Such communication network includes a 
radio transmission section For example, when perform- 
ing data transmission between a video distribution 
server and a visual terminal through a relay server, the 
section between the distribution server and the relay 

w server is a cable transmission section by the Internet, 
but the section between the relay server and the visual 
terminal is a radio transmission section by a mobile 
phone network such as the W-CDMA. 
[0012] However, the bit error rate in the radio trans- 

15 mission section is 10~ 3 while the bit error rate in the 
cable transmission section is 10" 5 ~ 10" 7 , and the radio 
transmission quality becomes a problem in the RTP 
type data transmission method in which the reproduc- 
tion quality depends on the end to- end (server-to-termi- 

20 nal) transmission quality. 

SUMMARY OF THE INVENTION 

[001 3] The present invention is made to solve the 

25 above-described problems and has for its object to pro- 
vide a data transmission method, a data transmission 
apparatus, and a data receiving apparatus, which can 
improve the transmission quality in a radio section in 
real-time transmission. 

30 [0014] Other objects and advantages of the inven- 
tion will become apparent from the detailed description 
that follows. The detailed description and specific 
embodiments described are provided only for illustra- 
tion since various additions and modifications within the 

35 scope of the invention will be apparent to those of skill in 
the art from the detailed description. 
[0015] According to a first aspect of the present 
invention, there is provided a data transmission method 
for performing continuous data transmission from the 

40 transmitting end to the receiving end in units of packets, 
each packet having additional information relating to its 
sequence number, priority, and data reproduction time 
at the receiving end, while successively reproducing 
data of packets received at the receiving end. This 

45 method comprising the steps of: at the transmitting end, 
giving priority information to each packet to be transmit- 
ted; and storing, as retransmission data, only data of 
packets the priorities of which are equal to or higher 
than a predetermined value, in a retransmission buffer; 

so at the receiving end, when a transmission error is 
detected, detecting the priority information of an error 
packet; and when the detected priority is equal to or 
higher than the predetermined value, outputting a 
retransmission request for the error packet to the trans- 

55 mitting end by indicating the sequence number of this 
error packet; at the transmitting end, only when the data 
of the packet having the sequence number which is indi- 
cated by the retransmission request from the receiving 
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end is stored in the retransmission buffer, retransmitting 
the data of this packet to the receiving end; and discard- 
ing the data stored in the retransmission buffer in order 
starting from a packet which cannot be in time for data 
reproduction at the receiving end. Therefore, the trans- 
mission quality in a radio section in real-time transmis- 
sion is improved and, further, the number of 
retransmission times is reduced. 
[001 6] According to a second aspect of the present 
invention, in the data transmission method of the first 
aspect, when the retransmission buffer is filled up to its 
capacity, an updation process is performed, in which the 
retransmission data are retained while the data stored 
in the retransmission buffer are discarded in order, start- 
ing from a packet of the earliest reproduction time, on 
the basis ot the reproduction time of each packet stored 
in the retransmission buffer. Therefore, the transmission 
quality in a radio section in real-time transmission is 
improved and, further, the number of retransmission 
times is reduced. 

[0017] According to a third aspect of the present 
invention, in the data transmission method of the first 
aspect, when the data transmitted from the transmitting 
end to the receiving end is video data based on MPEG, 
a packet which contains data corresponding to frames 
coded by utilizing intra -Irame correlation is regarded as 
a packet having a high priority. Therefore, the transmis- 
sion quality in a radio section in real-time transmission 
is improved and, further, the number of retransmission 
times is reduced. 

[0018] According to a fourth aspect of the present 
invention, in the data transmission method of the first 
aspect, at the transmitting end, the additional informa- 
tion relating to the sequence number and the priority of 
a predetermined packet is also embedded in a subse- 
quent packet to be transmitted after the predetermined 
packet; and at the receiving end, in the case where a 
transmission error has occurred in the predetermined 
packet and the additional information of the predeter- 
mined packet has an error, a retransmission request for 
the predetermined packet as an error packet is made on 
the basis of the additional information of the predeter- 
mined packet which is embedded in the subsequent 
packet, when the subsequent packet transmitted after 
the predetermined packet is received. Therefore, the 
transmission quality in a radio section in real-time trans- 
mission is improved and, further, the number of retrans- 
mission times is reduced. 

[0019] According to a fifth aspect of the present 
invention, in the data transmission method of the fourth 
aspect, at the transmitting end, the process of embed- 
ding the sequence number of a predetermined high pri- 
ority packet in a subsequent packet which follows the 
predetermined high priority packet is continuously per- . 
formed until a high priority packet next to the predeter- 
mined high priority packet is transmitted; and at the 
receiving end, the sequence number of another packet 
which is embedded in the received packet is extracted, 



and when a transmission error has occurred in the 
packet of the extracted sequence number, a retransmis- 
sion request for this error packet is made by indicating 
the sequence number of this packet. Therefore, the 
5 transmission quality in a radio section in real-time trans- 
mission is improved and, lurther, the number of retrans- 
mission times is reduced. 

[0020] According to a sixth aspect of the present 
invention, there is provided a data transmission appara- 

io tus for relaying data which are successively transmitted 
from the transmitting end in units of packets, each 
packet having additional information relating to its 
sequence number, priority, data reproduction time at the 
receiving end. This apparatus comprises: a receiving 

is unit for receiving the packets transmitted trom the trans- 
mitting end; a priority decision unit for deciding the pri- 
ority of each of the received packets; a retransmission 
packet storage unit for storing packets the priorities of 
which are equal to or higher than a predetermined 

20 value, as retransmission packets, on the basis of the pri- 
ority of each packet decided by the priority decision unit; 
a retransmission instruction receiving unit for receiving 
a retransmission request from a terminal at the receiv- 
ing end; a retransmission decision unit for deciding 

25 whether retransmission of the packet for which the 
retransmission request has been made should be per- 
formed or not, on the basis of the retransmission 
request and the storage status of the retransmission 
packets in the retransmission packet storage unit; a 

30 transmission queue management unit for setting the 
transmission order of the received packets and the 
packets which have been decided as packets to be 
retransmitted, on the basis of the additional information; 
and a transmission unit for transmitting the data of these 

35 packets in the transmission order set by the manage- 
ment unit. Therefore, only the error packets the priorities 
of which are equal to or higher than a predetermined 
value can be retransmitted, whereby the transmission 
quality of a radio section in real -lime transmission is 

40 improved and, further, the number of retransmission 
times is reduced. 

[0021 ] According to a seventh aspect of the present 
invention, there is provided a data receiving apparatus 
for receiving data which are transmitted from the trans- 

45 mining end in units of packets, each packet having addi- 
tional information relating to its sequence number, 
priority, and data reproduction time at the receiving end, 
and successively reproducing the data for each packet. 
This apparatus comprises: a receiving unit for receiving 

so the packets transmitted from the transmitting end; an 
error packet detection unit for detecting error packets in 
which errors have occurred during transmission, and 
outputting normal packets which have been transmitted 
without transmission errors, on the basis of the data of 

55 the received packets; a packet priority decision unit for 
receiving the output from the error packet detection unit, 
and deciding error packets the priorities of which are 
equal to or higher than a predetermined value; and a 
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retransmission instruction output unit for outputting a 
retransmission request for each of the error packets the 
priorities of which are decided as being equal to or 
higher than the predetermined value, to the transmitting 
end, by indicating the sequence number of this error 
packet. Therefore, at the receiving end, a retransmis- 
sion request to the transmitting end is made only for the 
error packet the priority of which is equal to or higher 
than a predetermined value, whereby the transmission 
quality in a radio section in real-time transmission is 
improved and, further, the number of retransmission 
times is reduced. 

[0022] According to an eighth aspect of the present 
invention, there is provided a data transmission method 
in which data transmission from the transmitting end to 
the receiving end is continuously performed in units of 
packets, each packet having additional information 
relating to its sequence number, priority, and data repro- 
duction time at the receiving end, while successively 
reproducing data of packets which have arrived at the 
receiving end and, at this time, only packets which can 
be in time for data reproduction at the receiving end are 
retransmitted- This method comprises the steps of: at 
the transmitting end, giving a data reproduction time at 
the receiving end to each packet to be transmitted; and 
storing, as retransmission data, only data of packets the 
priorities of which are equal to or higher than a predeter- 
mined value, in a retransmission buffer; at the receiving 
end, when a transmission error is detected, detecting 
the reproduction time for an error packet and the arrival 
time of the error packet, and deciding an arrival time 
limit in accordance with the reproduction time; and 
when the error packet has arrived before the arrival time 
limit, outputting a retransmission request tor the error 
packet to the transmitting end by indicating the 
sequence number of this error packet; at the transmit- 
ting end, when the data of the packet having the 
sequence number indicated by the retransmission 
request from the receiving end is stored in the retrans- 
mission buffer, retransmitting data of the packet the 
transmission time of which does not pass the reproduc- 
tion time, to the receiving end, while discarding data of 
the packet the transmission time of which has passed 
the reproduction time; and discarding the data stored in 
the retransmission buffer in order starting from a packet 
which cannot be in time for data reproduction at the 
receiving end. Therefore, the transmission quality in a 
radio section in real-time transmission is improved and, 
further, the number of retransmission times is reduced. 
[0023] According to a ninth aspect of the present 
invention, in the data transmission method of the eighth 
aspect, when the retransmission buffer is titled up to its 
capacity, an updation processes is performed, in which 
the retransmission data are retained while the data 
stored in the retransmission buffer are discarded in 
order, starting from a packet of the earliest reproduction 
time, on the basis of the reproduction time of each 
packet stored in the retransmission buffer. Therefore, 



the transmission quality in a radio section in real-time 
transmission is improved and, further, the number of 
retransmission times is reduced. 
[0024] According to a tenth aspect of the present 

5 invention, in the data transmission method of the eighth 
aspect, the arrival time limit is decided based on at least 
one of the allowable packet delay time decided at the 
receiving end, and the packet transmission delay time 
between the transmitting end and the receiving end. 

10 Therefore, the transmission quality in a radio section in 
real-time transmission is improved and, further, the 
number of retransmission times is reduced. 
[0025] According to an eleventh aspect of the 
present invention, in the data transmission method of 

15 the eighth aspect, at the transmitting end, additional 
information relating to the sequence number and the 
reproduction time corresponding to a target packet to be 
transmitted is embedded in a subsequent packet to be 
transmitted after the target packet; and at the receiving 

20 end, when a transmission error of the target packet has 
occurred and the additional information of the target 
packet has an error, a retransmission request for the tar- 
get packet as an error packet is made on the basis of 
the additional information of the target packet which is 

25 embedded in the subsequent packet, when the subse- 
quent packet transmitted after the target packet is 
received. Therefore, the transmission quality in a radio 
section in real-time transmission is improved and, fur- 
ther, the number of retransmission times is reduced. 

30 [0026] According to a twelfth aspect of the present 
invention, there is provided a data transmission appara- 
tus for relaying data which are successively transmitted 
from the transmitting end in units of packets, each 
packet having additional information relating to its 

35 sequence number, priority, data reproduction time at the 
receiving end. This apparatus comprises: a receiving 
unit for receiving the packets transmitted from the trans- 
mitting end; a priority decision unit for deciding the pri- 
ority of each of the received packets; a reproduction 

40 time decision unit for deciding packets which cannot be 
in time for reproduction at the receiving end, amongst 
the packets to be transmitted to the receiving end; a 
retransmission packet storage unit for storing packets 
the priorities of which are equal to or higher than a pre- 

45 determined value, as retransmission packets, on the 
basis of the priority of each packet decided by the prior- 
ity decision unit; a retransmission instruction receiving 
unit for receiving a retransmission request from a termi- 
nal at the receiving end; a retransmission decision unit 

so for deciding whether retransmission of the packet for 
which the retransmission request has been made 
should be performed or not, on the basis of the retrans- 
mission request and the storage status of the retrans- 
mission packets in the retransmission packet storage 

55 unit; a transmission queue management unit for setting 
the transmission order of the received packets and the 
packets which have been decided as packets to be 
retransmitted, on the basis of the additional information; 
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and a transmission unit for transmitting, in the transmis- 
sion order set by the management unit, the data of 
packets other than the packets which are decided as 
packets that cannot be in time for reproduction at the 
receiving end, by the reproduction time decision unit. 
Therefore, the transmission quality in a radio section in 
real-time transmission is improved and, further, the 
number of retransmission times is reduced. 
[0027] According to a thirteenth aspect of the 
present invention, there is provided a data receiving 
apparatus for receiving data which are transmitted from 
the transmitting end in units of packets, each packet 
having additional information relating to its sequence 
number, priority, and data reproduction time at the 
receiving end, and successively reproducing the data 
for each packet. This apparatus comprises: a receiving 
unit for receiving the packets transmitted from the trans- 
mitting end; an error packet detection unit for detecting 
error packets in which errors have occurred during 
transmission, and outputting normal packets which 
have been transmitted without transmission errors, on 
the basis of the data of the received packets; a repro- 
duction time decision unit for detecting the reproduction 
time given to each error packet detected by the error 
packet detection unit and the arrival time of the error 
packet at the receiving end. and setting the arrival time 
limit based on the reproduction time, and deciding 
whether or not the error packet has arrived at the receiv- 
ing end before the arrival time limit; and a retransmis- 
sion instruction output unit for outputting a 
retransmission request only for the error packet which 
has arrived at the receiving end before the arrival time 
limit, to the transmitting end, by indicating the sequence 
number of the error packet, on the basis of the result of 
the decision in the reproduction time decision unit. 
Therefore, the transmission quality in a radio section in 
real-time transmission is improved and, further, the 
number of retransmission times is reduced. 
[0028] According to a fourteenth aspect of the 
present invention, there is provided a data transmission 
method for performing continuous data transmission 
from the transmitting end to the receiving end in units of 
packets, each packet having additional information 
relating to its sequence number, priority, and data repro- 
duction time at the receiving end, while successively 
reproducing data of packets arrived at the receiving 
end. This method comprises the steps of: at the trans- 
mitting end, giving a data reproduction time and priority 
information to each packet to be transmitted; and stor- 
ing, as retransmission data, only data of packets the pri- 
orities of which are equal to or higher than a 
predetermined value, in a retransmission buffer; at the 
receiving end, when a transmission error is detected, 
detecting the priority information of an error packet, the 
reproduction time of the error packet, and the arrival 
time of the error packet; setting the arrival time limit of 
the error packet on the basis of the reproduction time; 
and when the detected priority is equal to or higher than 



the predetermined value and the error packet has 
arrived before the arrival time limit, outputting a retrans- 
mission request for this error packet to the transmitting 
end by indicating the sequence number of this error 

5 packet; at the transmitting end, when data of the packet 
having the sequence number indicated by the retrans- 
mission request from the receiving end is stored in the 
retransmission buffer, retransmitting only data of the 
packet the transmission time of which does not pass the 

10 reproduction time, to the receiving end, while discarding 
data of the packet the transmission time of which has 
passed the reproduction time; and discarding the data 
stored in the retransmission buffer in order starting from 
a packet which cannot be in time for reproduction at the 

15 receiving end. Therefore, the transmission quality in a 
radio section in real time transmission is improved and, 
further, the number of retransmission times is reduced. 
[0029] According to a fifteenth aspect of the present 
invention, in the data transmission method of the four- 

20 teerrth aspect, at the transmitting end, additional infor- 
mation relating to the sequence number, the priority, 
and the reproduction time of a predetermined packet is 
embedded in a subsequent packet to be transmitted 
after the predetermined packet; and at the receiving 

25 end, when a transmission error of the predetermined 
packet has occurred and the additional information of 
the predetermined packet has an error, a retransmis- 
sion request for the predetermined packet as an error 
packet is made on the basis of the additional informa- 

30 tion of the predetermined packet which is embedded in 
the subsequent packet, when the subsequent packet 
transmitted after the predetermined packet is received. 
Therefore, the transmission quality in a radio section in 
real-time transmission is improved and, further, the 

35 number of retransmission times is reduced. 

[0030] According to a sixteenth aspect of the 
present invention, in the data transmission method of 
the fifteenth aspect, at the transmitting end, the process 
of embedding the sequence number of a predetermined 

40 high priority packet in a subsequent packet which fol- 
lows the predetermined high priority packet is continu- 
ously performed until a high priority packet next to the 
predetermined high priority packet is transmitted; and at 
the receiving end, the sequence number of another 

45 packet which is embedded in the received packet is 
extracted, and when a transmission error has occurred 
in the packet of the extracted sequence number, a 
retransmission request for this packet is made by indi- 
cating the sequence number of this packet. Therefore, 

bo the transmission quality in a radio section in real-time 
transmission is improved and, further, the number of 
retransmission times is reduced. 
[0031] According to a seventeenth aspect of the 
present invention, in the data transmission method of 

55 the fifteenth aspect, at the transmitting end, when addi- 
tional information relating to the sequence number and 
the reproduction time corresponding to each packet is 
embedded in a subsequent packet to be transmitted 
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after the packet, a difference between additional infor- 
mation relating to the sequence number and the repro- 
duction time corresponding to the subsequent packet 
and the additional information relating to the sequence 
number and the reproduction time corresponding to the 
previous packet is embedded as the additional informa- 
tion. Therefore, the transmission quality in a radio sec- 
tion in real-time transmission is improved and, further, 
the number of retransmission times is reduced. 
[0032] According to an eighteenth aspect of the 
present invention, there is provided a data transmission 
method tor performing data transmission between a dis- 
tribution server and a terminal through a relay server in 
units of packets, and successively reproducing data of 
packets received at the terminal. This method compris- 
ing the steps of: when a transmission error has occurred 
between the relay server and the terminal, performing 
retransmission of an error packet by the relay server in 
response to a retransmission request from the terminal; 
and when a transmission error has occurred between 
the distribution server and the relay server, performing 
retransmission of an error packet by the distribution 
server in response to a retransmission request which 
has been transmitted from the terminal through the 
relay server. Therefore, the number of retransmission 
times is reduced between the distribution server and the 
relay server. 

[0033] According to a nineteenth aspect of the 
present invention, in the data transmission method of 
the eighteenth aspect, when a transmission error has 
occurred between the distribution server and the relay 
server, a retransmission request is transmitted from the 
relay server to the distribution server, and retransmis- 
sion of an error packet to the relay server is performed 
by the distribution server. Therefore, wasteful transmis- 
sion of error packets from the relay server to the termi- 
nal is avoided. 

[0034] According to a twentieth aspect of the 
present invention, there is provided a data transmission 
apparatus for relaying data which are successively 
transmitted from a distribution server, in units of packets 
each having additional information relating to its 
sequence number, priority, data reproduction time at the 
receiving end. This apparatus comprises: a receiving 
unit for receiving the packets transmitted from the trans- 
mitting end; a priority decision unit for deciding the pri- 
ority of each of the received packets; a retransmission 
packet storage unit for storing packets the priorities of 
which are equal to or higher than a predetermined 
value, as retransmission packets, on the basis of the pri- 
ority of each packet decided by the priority decision unit; 
a retransmission instruction receiving unit for receiving 
a retransmission request from a terminal at the receiv- 
ing end; a retransmission decision unit for deciding 
whether retransmission of the packet for which the 
retransmission request has been made is to be per- 
formed or not, on the basis of the retransmission 
request and the storage status of the retransmission 



packets in the retransmission packet storage unit; a 
retransmission instruction output unit for outputting the 
retransmission request for the error packet requested 
by the terminal, to the distribution server, on the basis of 

5 the result of the decision in the retransmission decision 
unit; a transmission queue management unit for setting 
the transmission order of the received packets and the 
packets which have been decided as packets to be 
retransmitted, on the basis of the additional information; 

jo and a transmission unit for transmitting the data of these 
packets in the transmission order set by the manage- 
ment unit. Therefore, the number of retransmission 
times between the distribution server and the relay 
server can be reduced. 

15 [0035] According to a twenty-first aspect of the 
present invention, there is provided a data transmission 
method for performing continuous data transmission 
from the transmitting end to the receiving end in units of 
packets, each packet having additional information 

20 relating to its sequence number, priority, and data repro- 
duction time at the receiving end, while successively 
reproducing data of packets received at the receiving 
end. This method comprises the steps of: at the trans- 
mitting end, when a packet the priority of which is equal 

25 to or higher than a predetermined value is transmitted 
as a high priority packet, storing data of this high priority 
packet, as retransmission data, in a retransmission 
buffer; managing the value of the transmitting end high 
priority sequence number which corresponds to the 

30 number of transmitted high priority packets, and the 
value of the sequence number of the high priority packet 
so that these values are correlated with each other; and 
transmitting a subsequent packet which follows the high 
priority packet after embedding the value of the trans- 

35 mitting end high priority sequence number in this subse- 
quent packet; at the receiving end, extracting the value 
of the transmitting end high priority sequence number 
which is embedded in the received packet; managing 
the value of the receiving end high priority sequence 

40 number which corresponds to the number of received 
high priority packets; when the value of the extracted 
transmitting end high priority sequence number is not 
equal to the value of the receiving end high priority 
sequence number, outputting a retransmission request 

45 to the transmitting end, by indicating the value of the 
transmitting end high priority sequence number which is 
obtained on the basis of the value of the receiving end 
high priority sequence number; and updating the value 
of the receiving end high priority sequence number; at 

so the transmitting end, only when data of the packet hav- 
ing the sequence number corresponding to the value of 
the transmitting end high priority sequence number 
which is indicated by the retransmission request from 
the receiving end is stored in the retransmission buffer. 

55 retransmitting the data of this packet to the receiving 
end. Therefore, retransmission of the high priority 
packet the priority of which is equal to or higher than a 
predetermined value, can be performed by simpler pro- 
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cedures. 

[0036] According to a twenty-second aspect of the 
present invention, in the data transmission method of 
the twenty-first aspect, at the receiving end, when the 
value of the transmitting end high priority sequence 
number embedded in the received packet is not equal to 
the value of the receiving end high priority sequence 
number, a retransmission request is output to the trans- 
mitting end, by listing the values ranging from the value 
obtained by adding 1 to the receiving end high priority 
sequence number, to the value of the transmitting end 
high priority sequence number, as the values of the 
transmitting end high priority sequence numbers, or by 
designating the range as the range of the values of the 
transmitting end high priority sequence numbers; and at 
the transmitting end, the sequence numbers corre- 
sponding to the values of the plural transmitting end 
high priority sequence numbers which are indicated by 
the retransmission request from the receiving end are 
retrieved, and only when data of the packets having the 
sequence numbers obtained by the retrieval are stored 
in the retransmission buffer, the data of the packets are 
retransmitted to the receiving end. Therefore, retrans- 
mission of the high priority packet the priority of which is 
equal to or higher than a predetermined value, can be 
performed by simpler procedures. 
[0037] According to a twenty-third aspect of the 
present invention, in the data transmission method of 
the twenty-first aspect, at the receiving end, the retrans- 
mission request is performed continuously be several 
times, indicating the value of a transmitting end high pri- 
ority sequence number ; and at the transmitting end, the 
sequence number corresponding to the value of the 
transmitting end high priority sequence number which is 
indicated by the retransmission request from the receiv- 
ing end is retrieved, and data of the packet having the 
sequence number obtained by the retrieval is retrans- 
mitted to the receiving end and, simultaneously, the cor- 
respondence between the value of the sequence 
number obtained by the retrieval and the value of the 
transmitting end high priority sequence number indi- 
cated by the receiving end is deleted. Therefore, when 
at least one of several transmission requests from the 
receiving end is normally received at the transmitting 
end, only the error packet the priority of which is equal 
to or higher than a predetermined value can be retrans- 
mitted, whereby the transmission quality in a radio sec- 
tion in real-time transmission can be effectively 
improved. 

[0038] According to a twenty-fourth aspect of the 
present invention, there is provided a data transmission 
apparatus for relaying data which are successively 
transmitted from the transmitting end in units of packets, 
each packet having additional information relating to its 
sequence number, priority, data reproduction time at the 
receiving end. This apparatus comprises: a receiving 
unit for receiving the packets transmitted from the trans- 
mitting end; a transmission queue management unit for 



setting the transmission order of the received packets 
and packets which are decided as packets to be 
retransmitted; a transmission unit for transmitting data 
of these packets in the transmission order set by the 

; transmission queue management unit; a priority deci- 
sion unit for deciding the priority of each of the received 
packets; a retransmission packet storage unit for storing 
packets the priorities of which are equal to or higher 
than a predetermined value, as retransmission packets, 

io on the basis of the priority of each packet decided by the 
priority decision unit; a sequence number management 
unit for managing the value of the transmitting end high 
priority sequence number which corresponds to the 
number of transmitted high priority packets, and the 

is value of the sequence number of the high priority packet 
so that these values are correlated with each other; a 
high priority sequence number insertion unit for embed- 
ding the value of the transmitting end high priority 
sequence number in a subsequent packet which follows 

20 the high priority packet; a retransmission instruction 
receiving unit for receiving a retransmission request 
indicating the high priority sequence number, from a ter- 
minal at the transmitting end; and a retransmission deci- 
sion unit for deciding whether retransmission of the 

25 packet for which the retransmission request has been 
made is to be performed or not, on the basis of the 
retransmission request and the storage status of the 
retransmission packets in the retransmission packet 
storage unit. Therefore, only the error packet the priority 

30 of which is equal to or higher than a predetermined 
value can be retransmitted, whereby retransmission of 
the high priority packet can be performed by simpler 
procedures. 

[0039] According to a twenty-fifth aspect of the 

35 present invention, there is provided a data receiving 
apparatus for receiving data which are transmitted from 
the transmitting end in units of packets, each packet 
having additional information relating to its sequence 
number, priority, and data reproduction time at the 

40 receiving end, and successively reproducing the data 
for each packet. This apparatus comprises: a receiving 
unit for receiving the packets transmitted Irom the trans- 
mitting end; an error packet detection unit for detecting 
an error packet in which an error has occurred during 

45 transmission, and outputting a normal packet which has 
been transmitted without transmission errors, and the 
value of the transmitting end high priority sequence 
number which corresponds to the number of transmitted 
high priority packets and is embedded in the normal 

so packet; a high priority sequence number management 
unit for managing the value of the receiving end high pri- 
ority sequence number which corresponds to the 
number of normal high priority packets which have been 
received without transmission errors, on the basis of the 

55 output from the error packet detection unit; a retrans- 
mission sequence number decision unit for comparing 
the value of the transmitting end high priority sequence 
number from the error packet detection unit with the 
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value of the receiving end high priority sequence 
number, and when these values are not equal, deciding 
the value of the transmitting end high priority sequence 
number for which a retransmission request is to be 
made, on the basis of the value of the receiving end 5 
high priority sequence number; and a retransmission 
instruction output unit for outputting a retransmission 
request to the transmitting end, by indicating the value 
of the decided transmitting end high priority sequence 
numoer. Therefore, retransmission of the high priority 10 
packet can be performed with simpler procedures. 
[0040] According to a twenty-sixth aspect of the 
present invention, there is provided a data structure of a 
packet for performing data transmission from the trans- 
mining end and the receiving end, wherein the packet 15 
comprises a header section containing relevant infor- 
*<on indicating the attribute of the packet, and a data 
. ion containing data to be transmitted; and the 
header section comprises at least first and second 
header information, amongst first header information 20 
indicating the sequence number corresponding to the 
packet, second header information indicating the prior- 
ity of the packet, and third header information indicating 
the reproduction time at the receiving end, of the data to 
be transmitted. Therefore, retransmission of a low prior- 25 
ity packet and retransmission of a packet which cannot 
be in time for reproduction can be avoided, whereby the 
transmission quality in a radio section in real-time trans- 
mission is improved while reducing the number of 
retransmission times. 3° 
[0041] According to a twenty-seventh aspect of the 
present invention, in the packet data structure of the 
twenty-sixth aspect, the header section of the packet 
includes attribute information of a packet which has 
already been transmitted before the packet. Therefore, 35 
retransmission of an error packet can be performed with 
reliability. 

[0042] According to a twenty-eighth aspect of the 
present invention, in the packet data structure of the 
twenty-seventh aspect, the header section of the packet 40 
includes the first and second information or the first and 
third information, as attribute information of a packet 
which has already been transmitted before the packet. 
Therefore, retransmission control based on the priority 
or the reproduction time can be performed with reliabil- 45 
<ty. 

[0043] According to a twenty-ninth aspect of the 
present invention, in the packet data structure of the 
twenty-sixth aspect, the header section of the packet 
includes the value of the high priority sequence number 50 
corresponding to the number of high priority packets 
which have been transmitted before the packet and hav- 
ing the priorities equal to or higher than a predeter- 
mined value. Therefore, the transmission quality in a 
radio section in real-time transmission is improved and, 55 
moreover, retransmission of an error packet is realized 
by simpler procedures. 



BRIEF DESCRI P TION OF THF DRAWINGS 
[0044] 

Figures 1(a) and 1(b) are block diagrams for 
explaining data transmission apparatuses as a 
relay server and a distribution server, respectively, 
in a data transmission system according to a first 
embodiment of the present invention. 
Figure 2 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the first embodi- 
ment. 

Figure 3 is a sequence diagram for explaining 
packet selective retransmission control in a data 
transmission method according to the first embodi- 
ment. 

Figure 4 is a block diagram illustrating a data trans- 
mission apparatus (relay server) in a data transmis- 
sion system according to a second embodiment of 
the present invention. 

Figure 5 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the second 
embodiment. 

Figure 6 is a sequence diagram for explaining 
packet selective retransmission control in a data 
transmission method according to a third embodi- 
ment of the present invention. 
Figure 7 is a block diagram illustrating a data trans- 
mission apparatus (relay server) in a data transmis- 
sion system according to a modification of the third 
embodiment. 

Figure 8 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the modification 
of the third embodiment- 
Figure 9 is a sequence diagram for explaining 
packet selective retransmission control in a data 
transmission method according to the modification 
of the third embodiment. 

Figure 10 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to a fourth embodi- 
ment of the present invention. 
Figure 11 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the fourth 
embodiment. 

Figure 12 is a sequence diagram for explaining a 
first example of packet selective retransmission 
control in a data transmission method according to 
the fourth embodiment. 

Figure 13 is a sequence diagram for explaining a 
second example of packet selective retransmission 
control in the data transmission method according 
to the fourth embodiment. 
Figure 14 is a sequence diagram for explaining a 
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third example of packet selective retransmission 
control in the data transmission method according 
to the fourth embodiment. 
Figure 15 is a sequence diagram for explaining a 
fourth example of packet selective retransmission 5 
control in a data transmission method according to 
a modification of the fourth embodiment. 
Figures 16(a) and 16(b) are block diagrams for 
explaining a data transmission apparatus as a relay 
server and a data receiving apparatus as a receiv- 10 
ing terminal, respectively, in a data transmission 
system according to a fifth embodiment of the 
present invention. 

Figure 17 is a sequence diagram for explaining 
packet selective retransmission control in a data is 
transmission method according to the fifth embodi- 
ment. 

Figure 18 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to a sixth embodi- 20 
ment of the present invention. 
Figure 19 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the sixth embod- 
iment. 25 
Figure 20 is a sequence diagram for explaining 
packet retransmission control with time limit, in the 
data transmission method according to the sixth 
embodiment. 

Figure 21 is a sequence diagram for explaining 30 
packet retransmission control with time limit, in a 
data transmission method according to an modifi- 
cation of the sixth embodiment. 
Figure 22 is a sequence diagram for explaining 
packet retransmission control with time limit, in a 35 
data transmission method according to another 
modification of the sixth embodiment. 
Figure 23 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to a seventh 40 
embodiment of the present invention. 
Figure 24 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to a modification of 
the seventh embodiment. 45 
Figure 25 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to an eighth embod- 
iment of the present invention. 

Figure 26 is a block diagram illustrating a data so 
receiving apparatus (receiving terminal) in the data 
transmission system according to the eighth 
embodiment. 

Figures 27(a) and 27(b) are diagrams for explaining 
a reproduction time estimation method according to ss 
the eighth embodiment, illustrating the relationship 
between the time stamp of a packet and the packet 
output time (figure 27(a)) and a time stamp map- 



ping method (figure 27(b)). 
Figures 28(a) and 28(b) are schematic diagrams for 
conceptually explaining the conventional video 
transmission system, illustrating a server and a ter- 
minal connected by a cable (figure 28(a)), and a 
server and a terminal connected by a network 
including a radio transmission section. 
Figures 29(a) and 29(b) are block diagrams for 
explaining a data transmission apparatus as a relay 
server and a data transmission apparatus as a dis- 
tribution server, respectively, in a data transmission 
system according to a ninth embodiment of the 
present invention. 

Figure 30 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the ninth embod- 
iment. 

Figure 31 is a sequence diagram for explaining 
packet selective retransmission control in the real- 
time data transmission method according to the 
ninth embodiment. 

Figure 32 is a block diagram illustrating a data 
transmission apparatus (relay server) in a data 
transmission system according to a tenth embodi- 
ment of the present invention. 
Figure 33 is a block diagram illustrating a data 
receiving apparatus (receiving terminal) in the data 
transmission system according to the tenth embod- 
iment. 

Figures 34(a)-34(c) are diagrams illustrating the 
data structure of a packet for transmitting data by a 
data transmission method according to any of the 
aforementioned embodiments (figure 34(a)), the 
structure of the packet header (figure 34(b)). and 
the convention of header information (figure 34(c)). 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0045] Hereinafter, the inventor's viewpoint and the 
fundamental principle of the present invention will be 
described. 

[0046] The inventors of the present invention have 
earnestly studied about a method for improving the 
transmission quality in a network including a radio trans- 
mission section, and finally discovered that the trans- 
mission quality in the radio section can be improved by 
performing real-time retransmission of packets, in the 
existing real-time transmission method. 
[0047] To be specif ic, in the existing real-time trans- 
mission method, packet data are transmitted in real time 
between a distribution server and a terminal unit 
through a relay server or the like, and additional infor- 
mation (e.g.. a sequence number, a time stamp, etc) 
required for real-time transmission of each packet data 
is given to the header of the packet. The additional infor- 
mation enables real-time control of packet retransmis- 
sion. 
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[0048] In the data transmission method of the 
present invention in which data transmission is per- 
formed in real time between the distribution server and 
the terminal through the relay server while retransmis- 
sion control is performed in real time, the relay server 5 
may serve as the video distribution server. Further, as 
for the video data transmission direction, the present 
invention can be applied to not only the forward trans- 
mission from the distribution server to the terminal but 
also the backward transmission from the terminal to the 1 0 
distribution server. 

[0049] Further, in the present invention, tor effective 
real-time transmission, control of transmission QoS 
(Quality of Service) in the relay server is realized. 
[0050] Next, the summary of real time retransmit- 15 
sion control in the data transmission method of the 
present invention will be briefly described. 
[0051] While the real-time retransmission control of 
the present invention regards the transmission quality of 
the radio section and recovers error packets due to 20 
radio transmission error by retransmission of the pack- 
ets, the conventional retransmission control is directed 
to realize high reliability in data transmission (error-free 
transmission). That is, in order to recover all error pack- 
ets, retransmission of error packets is repeated until 25 
data are correctly transmitted to the receiving end. In 
the conventional retransmission control, when the final 
error packet retransmission has failed, the data trans- 
mission is abnormally ended as a communication error 
[0052] By the way, in the retransmission control 30 
required for the real-time video data transmission, even 
when a transmission error occurs while predetermined 
packets are transmitted and thereby several frames of 
images are lost, this is not a fatal transmission error 
which leads to abnormal end of data transmission. 35 
Accordingly, in the video data transmission method, to 
complete real-time transmission with a measure of reli- 
ability is given the highest priority. 
[0053] For example, in transmission of a video sig- 
nal based on MPEG standard, in the case where a 40 
packet corresponding to an I frame (intra -frame coded 
image) as a reference image becomes an error packet, 
even when subsequent packets corresponding to a P 
frame (inter-frame forward-prediction coded image) and 
a B frame (inter-frame bidirectional-prediction coded 45 
image) are received normally, video signals of the P 
frame and the B frame cannot be reproduced. So, as for 
the I frame, it is necessary to recover the transmission 
error to the utmost. 

[0054] Further, in video transmission (stream type 50 
communication having an audio signal and a video sig- 
nal as objects to be transmitted), in contrast with the 
conventional retransmission control, it is necessary to 
perform retransmission while performing real-time 
transmission. 55 
[0055] In order to realize such real-time transmis- 
sion, the present invention provides a real-time trans- 
mission method in which the following retransmission 



control lor error packets is performed. 
[0056] First retransmission control is selective 
retransmission control for reducing the number of 
retransmission times by selecting, as packets to be 
retransmitted, high priority packets amongst the error 
packets. Second retransmission control is retransmis- 
sion control with time limit for reducing excessive 
retransmission by stopping retransmission of packets 
which cannot be in time for reproduction, amongst the 
error packets. 

[0057] Hereinafter, embodiments of the present 
invention will be described. 

[Embodiment 1] 

[0058] Figures 1-3 are diagrams for explaining a 
data transmission method according to a first embodi- 
ment of the present invention. 

[0059] In the data transmission method of this first 
embodiment, data transmission from the transmitting 
end to the receiving end is continuously performed in 
units of packets, each packet having additional informa- 
tion relating to its sequence number, priority and data 
reproduction time at the receiving end, while succes- 
sively reproducing data of packets received at the 
receiving end. At this time, only error packets the priori- 
ties of which are equal to or higher than a predeter- 
mined value are retransmitted. 
[0060] Figure 1(a) is a block diagram illustrating a 
data transmission apparatus 101 in a data transmission 
system which performs real-time data transmission 
according to the data transmission method of the first 
embodiment. 

[0061] This data transmission apparatus 101 con- 
stitutes a relay server (transmitting end) which relays 
data transmitted between a distribution server and a ter- 
minal (receiving end). This apparatus 101 includes a 
receiving unit 11, a transmission queue management 
unit 12, and a transmission unit 13. The receiving unit 
1 1 receives packets transmitted from the distribution 
server. The transmission queue management unit 12 
sets the transmission order of the received packets and 
the packets to be retransmitted (hereinafter referred to 
as retransmission packets) in accordance with the 
above-described additional information. The transmis- 
sion unit 13 transmits the packet data in the transmis- 
sion order which has been set by the transmission 
queue management unit 12. 

[0062] Each packet transmitted from the transmit- 
ting end is composed of a data section containing digital 
data such as video data, audio data, and text data, and 
a header section containing additional information other 
than these digital data. To be specific, the header sec- 
tion of each packet contains additional information relat- 
ing to its sequence number, priority, and data 
reproduction time at the receiving end. 
[0063] Further, the data transmission apparatus 
101 includes a buffer 17 for retransmission (hereinafter, 
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referred to as a retransmission buffer 17), a packet pri- 
ority decision unit 1 5, and a retransmission butter man- 
agement unit 18. The retransmission buffer 17 stores 
predetermined packets amongst the received packets, 
as retransmission packets. The packet priority decision 
unit 15 decides the priorities of the received packets. 
The retransmission buffer management unit 18 controls 
the retransmission buffer 17 such that data of packets 
the priorities of which are equal to or higher than a pre- 
determined value are stored in the buffer 1 7, in accord- 
ance with the decided priorities of the packets. To be 
specific, only when data of a packet having a sequence 
number indicated by a retransmission request from the 
receiving side is stored in the retransmission buffer 17, 
the retransmission decision unit 16 decides that data of 
this packet should be retransmitted to the receiving end. 
[0064] Further, the data transmission apparatus 
101 includes a retransmission instruction receiving unit 
1 4 and a retransmission decision unit 1 6. The retrans- 
mission instruction receiving unit 14 receives a retrans- 
mission instruction (hereinafter also referred to as a 
retransmission request) from the terminal at the receiv- 
ing end. The retransmission decision unit 16 decides 
whether retransmission of a packet for which the 
retransmission instruction has been made is performed 
or not. 

[0065] While in figure 1(a) the data transmission 
apparatus 101 constitutes a relay server, when the data 
transmission apparatus is a distribution server, it is con- 
structed as shown in figure 1(b). That is, in figure 1(b), 
the receiving unit 1 1 of the data transmission apparatus 
101 is replaced with a coded packet generation unit 10a 
which encodes the data and outputs the coded data in 
packet units, and a priority allocation unit 10b which 
allocates additional information such as a priority to 
each packet output from the coded packet generation 
unit 10a. 

[0066] Figure 2 is a block diagram illustrating a data 
receiving apparatus 201 in the data transmission sys- 
tem which performs real-time data transmission accord- 
ing to the data transmission method of the first 
embodiment. 

[0067] The data receiving apparatus 201 includes a 
receiving unit 21, an error packet detection unit 22, and 
a packet decoding unit 23. The receiving unit 21 
receives the packets transmitted from the relay server 
(the data transmission apparatus at the transmitting 
end). The error packet detection unit 22 detects error 
packets in which errors have occurred during transmis- 
sion, and outputs normal packets which have been 
transmitted without transmission errors. The packet 
decoding unit 23 receives the normal packets and 
decodes the coded data of the normal packets. 
[0068] Further, the data receiving apparatus 201 
includes a reception history management unit 24, a 
packet priority decision unit 25, and a retransmission 
instruction output unit 26. The reception history man- 
agement unit 24 manages the packet reception history. 



The packet priority decision unit 25 receives the result 
of the detection in the error packet detection unit 22 and 
decides an error packet the priority of which is equal to 
or higher than a predetermined value. The retransmis- 
5 sion instruction output unit 26 outputs a request for 
retransmitting the error packet which has been decided 
in the packet priority decision unit 25, toward the trans- 
mitting end, by indicating the sequence number of the 
error packet. 

70 [0069] Next, the function and effect will be 
described. 

[0070] Figure 3 is a sequence chart for explaining 
the packet selective retransmission control in the data 
transmission method of the first embodiment. 

75 [0071] In the data transmission method of this first 
embodiment, when an transmission error occurs during 
packet transmission, a retransmission request is made 
for only the packets the priorities of which are equal to 
or higher than a predetermined value, from the receiv- 
20 ing end to the transmitting end, while no retransmission 
request is made for the error packets the priorities of 
which are lower than the predetermined value. 
[0072] For example, assuming that the priorities 
equal to or higher than the predetermined value are 

25 high priorities while the priorities lower than the prede- 
termined value are low priorities, when an error occurs 
during transmission of a high priority packet (S1) of 
sequence number S1 , a retransmission request for this 
high priority packet (SI) is made. However, when an 

30 error occurs during transmission of a low priority packet 
(S2) of sequence number S2, no retransmission 
request is made for this low priority packet (S2). 
[0073] To be specific, each packet transmitted from 
the distribution server is given additional information 

35 relating to its sequence number and priority. In the data 
transmission apparatus 101 as a relay server, the trans- 
mission order of the received packets is set by the trans- 
mission queue management unit 12, and the packets 
are supplied to the transmission unit 13. On the other 

40 hand, the priorities of the received packets are decided 
by the packet priority decision unit 15. Then, in the 
transmission unit 13. transmission of these packets is 
performed according to the transmission order which 
has been set. Further, those packets the priorities of 

45 which are decided as being equal to or higher than the 
predetermined value are stored in the retransmission 
buffer 17 under control of the retransmission buffer 
management unit 17. Further, in the retransmission 
buffer 17, data are successively released (discarded) 

50 from the packets which cannot be in time for reproduc- 
tion, under control of the management unit 18. 
[0074] When the retransmission buffer 17 has no 
more vacant space (capacity), one of the following two 
processes is performed: a first updation process in 

55 which the above-described retransmission data is 
retained while the data of the packets stored in the 
retransmission buffer 17 are discarded in order starting 
from a packet of the earliest reproduction time; and a 
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second updation process in which the retransmission 
data is retained while successively discarding the data 
stored in the retransmission buffer 1 7 so that reproduc- 
tion of packet data for predetermined packets, amongst 
the packet of the earliest reproduction time and the sub- 
sequent packets, is performed at regular intervals at the 
receiving end. 

[0075] In this way, the packets from the distribution 
server are successively transmitted to the terminal (data 
receiving apparatus) 201 through the relay server (data 
transmission apparatus) 101. 

[0076] In the data receiving apparatus 201, the 
packets from the relay server (data transmission appa- 
ratus) 101 are received by the receiving unit 21 , and the 
received packets are supplied to the error packet detec- 
tion unit 22. Then, only the packets which have been 
transmitted without transmission errors are output from 
the error packet detection unit 22 to the packet decoding 
unit 23, and the additional information of each packet is 
supplied to the reception history management unit 24. 
At this time, the priority information of each error packet 
is supplied to the packet priority decision unit 25, 
wherein it is decided whether or not the priority of the 
error packet is equal to or higher than a predetermined 
value. With respect to the error packet the priority of 
which is equal to or higher than the predetermined 
value, the retransmission instruction output unit 26 out- 
puts a retransmission request to the transmitting end, 
by indicating the sequence number of this error packet. 
[0077] Then, in the data transmission apparatus 
101 at the transmitting end, the retransmission request 
is received by the retransmission instruction receiving 
unit 14, and it is decided by the retransmission decision 
unit 16 as to whether the packet of the sequence 
number indicated by the retransmission request is 
stored in the retransmission buffer 17 or not. When the 
packet of the sequence number indicated by the 
retransmission request is stored in the retransmission 
buffer 17, this packet is output as a retransmission 
packet, from the retransmission buffer 1 7 to the trans- 
mission queue management unit 12. In the transmission 
queue management unit 12, the retransmission packet 
is given a predetermined transmission order and then 
retransmitted to the receiving end through the transmis- 
sion unit 13. 

[0078] As described above, according to the first 
embodiment of the present invention, data transmission 
from the transmitting end to the receiving end is contin- 
uously performed in units of packets each having addi- 
tional information relating to its sequence number, 
priority, and data reproduction time and, simultaneously, 
data of the packets received at the receiving end are 
successively reproduced. With respect to error packets 
affected by transmission errors, only those having prior- 
ities equal to or higher than a predetermined value are 
retransmitted. Therefore, the transmission quality of the 
radio section in the real-time transmission is improved 
and, moreover, the number of retransmission times can 



be reduced. 

[0079] In this first embodiment, each packet may be 
given the frame type, such as I frame, P frame, and B 
frame, as the additional information, instead of the prior- 
5 ity. 

[0080] Further, there are various methods for decid- 
ing the packet priority. For example, in the case of a 
video signal based on the MPEG standard, packets cor- 
responding to I frames may be decided as high priority 
10 packets. 

[0081] Further, in the packet discarding process 
performed when the retransmission buffer is filled to the 
capacity, the above-described first or second updation 
process may be performed on the packets in the order 
15 of ascending priorities. 

[Embodiment 2] 

[0082] Figures 4-5 are diagrams for explaining a 

20 data transmission method according to a second 
embodiment of the present invention. 
[0083] Figure 4 is a block diagram illustrating a data 
transmission apparatus 102 in a data transmission sys- 
tem which performs real-time data transmission accord- 

25 ing to this data transmission method 

[0084] The data transmission apparatus 102 
includes an error correction unit 31 . in addition to the 
constituents of the data transmission apparatus 101 of 
the first embodiment. The error correction unit 31 per- 

30 forms an error correction process in which each packet 
output from the transmission queue management unit 
12 is given error correction codes for additional informa- 
tion such as its sequence number, priority, etc., and the 
packet which has been subjected to the error correction 

35 process is supplied to the transmission unit 13. Other 
constituents of the data transmission apparatus 102 are 
identical to those of the data transmission apparatus 
101 of the first embodiment. 

[0085] Figure 5 is a block diagram illustrating a data 
40 receiving apparatus 202 in the data transmission sys- 
tem which performs the real-time data transmission 
according to the data transmission method of this sec- 
ond embodiment 

[0086] The data receiving apparatus 202 of this 
45 second embodiment includes an error correction unit 
41, in addition to the constituents of the data receiving 
apparatus 201 of the first embodiment. The error cor- 
rection unit 41 performs an error correction process in 
which each packet received by the receiving unit 21 is 
so subjected to an error correction process in which the 
additional information of this packet is subjected to error 
correction by using the error correction codes given to 
the packet, and the packet which has been subjected to 
the error correction process is output to the error packet 
55 detection unit 22. Other constituents of the data receiv- 
ing apparatus 202 are identical to those of the data 
receiving apparatus 201 of the first embodiment 
[0087] Next, the function and effect will be 
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described. 

[0088] In the data transmission method according 
to the second embodiment, at the transmitting end, 
each packet to be transmitted is given error correction 
codes for the additional information relating to its 
sequence number, priority, etc. At the receiving end, the 
additional information is subjected to error correction 
according to the error correction codes and, thereafter, 
a retransmission request for the error packet is made in 
accordance with the additional information. Thereby, 
even when the sequence number and the priority infor- 
mation have errors, a retransmission request for the 
error packet can be correctly performed. 

[Embodiment 3] 

[0089] Figures 6-9 are diagrams for explaining 
data transmission methods according to a third embod- 
iment of the invention and a modification of the third 
embodiment. Figure 6 is a sequence diagram for 
explaining packet selective retransmission control in the 
data transmission method of the third embodiment. 
[0090] In the data transmission method of the third 
embodiment, at the transmitting end, additional informa- 
tion relating to the sequence number and priority of a 
predetermined packet is embedded in a subsequent 
packet which will be transmitted after the predetermined 
packet. At the receiving end, when a transmission error 
of the predetermined packet occurs and thereby the 
additional information of the predetermined packet has 
an error, a retransmission request for the error packet is 
made when receiving the subsequent packet which is 
transmitted after the error packet, in accordance with 
the additional information of the predetermined packet 
which is embedded in the subsequent packet 
[0091] For example, assuming that the priorities 
equal to or higher than a predetermined value are high 
priorities while the priorities lower than the predeter- 
mined value are low priorities, as shown in figure 6, 
when an error occurs during transmission of a high pri- 
ority packet (S1) of sequence number S1 and only a low 
priority packet (S2) of sequence number S2 which fol- 
lows the packet S1 is normally received, a retransmis- 
sion request for the high priority packet (S1) is made 
when the next low priority packet (S2) is received. 
[0092] On the other hand, when an error occurs 
during transmission of a low priority packet (S3) of 
sequence number S3 and only a high priority packet 
(S4) of sequence number S4 which follows the packet 
S3 is normally received, no retransmission request for 
the low priority packet S3 is made when the next high 
priority packet (S4) is received. 
[0093] In the data transmission method so con- 
structed, even when an error occurs during transmis- 
sion of a predetermined packet and thereby the 
sequence number or the priority information of this 
packet has an error, since the additional information 
(sequence number, priority, etc.) of the predetermined 



packet is embedded in the subsequent packet which is 
transmitted next to this packet, a transmission request 
for this error packet (predetermined packet) can be 
made correctly. 

5 [0094] While in this third embodiment the additional 
information of each packet is embedded in the next 
packet, it may be embedded in, not only the next packet, 
but also a plurality of subsequent packets. This con- 
struction will be described hereinafter as a modification 

10 of the third embodiment. 

[Modification of Embodiment 3] 

[0095] Figure 7 is a block diagram illustrating a data 

15 transmission apparatus 103 in a data transmission sys- 
tem which performs real-time data transmission by 
using a data transmission method according to the 
modification of the third embodiment. 
[0096] The data transmission apparatus 103 

20 includes a sequence number storage unit 33 and a 
sequence number insertion unit 32, in addition to the 
constituents of the data transmission apparatus 101 of 
the first embodiment. The sequence number storage 
unit 33 stores the sequence numbers of the packets the 

25 priorities of which are equal to or higher than a predeter- 
mined value, amongst the packets transmitted by a 
transmission unit 13a. The sequence number insertion 
unit 32 outputs each of the sequence numbers stored in 
the sequence number storage unit 33 to the transmis- 

30 sion unit 1 3a so that the sequence number is inserted in 
the header of the packet to be transmitted. Further, the 
transmission unit 13a of this modification is different 
from the transmission unit 13 of the first embodiment 
only in that it inserts the sequence number supplied 

35 from the sequence number insertion unit 32 into the 
header of the packet supplied from the transmission 
queue management unit 12, before transmitting the 
packet. Other constituents of the data transmission 
apparatus 103 are identical to those of the data trans- 

40 mission apparatus 1 0 1 of the first embodiment. 

[0097] Figure 8 is a block diagram illustrating a data 
receiving apparatus 203 in the data transmission sys- 
tem which performs the read-time data transmission by 
using the data transmission method according to the 

45 modification of the third embodiment. 

[0098] The data receiving apparatus 203 according 
to the modification of the third embodiment includes an 
inserted sequence extraction unit 42, in addition to the 
constituents of the data receiving apparatus 201 of the 

so first embodiment. The inserted sequence extraction unit 
42 extracts, from a normal packet output from the error 
packet detection unit 22. the sequence number of a high 
priority packet which has been received in advance of 
the normal packet. The normal packet is output to the 

55 packet decoding uriti. 23 through the inserted sequence 
extraction unit 42. Further, in the data receiving appara- 
tus 203, the packet priority decision unit 25a outputs a 
retransmission request to the retransmission instruction 
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output unit 26 when the packet of the sequence number 

extracted by the inserted sequence extraction unit 42 is 

an error packet. Other constituents of the data receiving 

unit 203 are identical to those of the data receiving 

apparatus 201 of the first embodiment. 

[0099] Next, the function and effect will be 

described, 

[0100] Figure 9 is a sequence diagram for explain- 
ing packet selective retransmission control in the data 
transmission method according to the modification of 
the third embodiment. 

[0101] In the data transmission apparatus (trans- 
mitting end) 103, in addition to the transmission opera- 
tion of the data transmission apparatus 101 according 
to the first embodiment, the process of embedding the 
sequence number of a high priority packet to be trans- 
mitted in the subsequent packets, is carried out until the 
next high priority is transmitted. 
[0102] For example, assuming that the priorities 
equal to or higher than a predetermined value are high 
priorities while the priorities tower than the predeter- 
mined value are low priorities, as shown in figure 9, after 
a high priority packet (S1) of sequence number S1 has 
been transmitted, subsequent packets (S2)~(S4) of 
sequence numbers S2-S4 are transmitted after the 
sequence number S1 of the previous high priority 
packet (S1) is embedded therein, and then a high prior- 
ity packet (S5) of sequence number S5 is transmitted 
after the sequence number S4 of the previous high pri- 
ority packet (S4) is embedded therein. 
[0103] When an error occurs while the high priority 
packet (S1) and the subsequent low priority packets 
(S2) and (S3) are transmitted and so only the high prior- 
ity packet (S4) is normally received, a retransmission 
request for the first high priority packet S1 is made when 
the next high priority packet (S4) is received. 
[0104] Further, in the data receiving apparatus 
(receiving end) 203, in addition to the receiving opera- 
tion of the data receiving apparatus 201 of the first 
embodiment, the lollowing retransmission is performed. 
That is, when the sequence number embedded in the 
received packet is extracted, if the packet correspond- 
ing to this sequence number is an error packet, a packet 
retransmission request is sent to the transmitting end by 
using the sequence number of this packet. 
[0105] In the data transmission method according 
to the modification of the third embodiment, at the trans- 
mitting end, the process of embedding the sequence 
number of a high priority packet, the priority of which is 
equal to or higher than a predetermined value, into the 
subsequent packets which follow this high priority 
packet, is continued until a high priority packet next to 
the high priority packet is transmitted. At the receiving 
end, the sequence number of another packet (high pri- 
ority packet) embedded in the received packet is 
extracted. When this packet (another packet) is an error 
packet, a retransmission request for this packet is made 
by indicating the sequence number of this packet. 



Therefore, even when two successive packets become 
error packets, the sequence number of the high priority 
packet which has become an error packet can be 
detected from the header information of the subsequent 

5 packet which is transmitted without a transmission error, 
whereby a retransmission request for the high priority 
error packet can be made with higher reliability. 
[0106] In the third embodiment, the sequence 
number and priority information of each packet are 

io embedded in the header of a packet to be transmitted 
next to this packet, and in the modification of the third 
embodiment, the sequence number of a high priority 
packet to be transmitted is embedded in the subsequent 
plural packets until the next high priority packet is trans- 

15 mitted. However, the information to be embedded in the 
subsequent packet is not restricted thereto. For exam- 
ple, the number of retransmission times may be embed- 
ded in the subsequent packet together with the 
sequence number. 

20 [01 07] In this case, at the transmitting end, informa- 
tion relating to the number of retransmission times is 
embedded in each packet together with the sequence 
number. At the receiving end, when making a retrans- 
mission request for an error packet, the number of 

25 retransmission times and the sequence number corre- 
sponding to the error packet are paired and indicated to 
the transmitting end. At the transmitting end, a selective 
retransmission process is performed as follows. That is. 
retransmission of the error packet for which the retrans- 

30 mission request has been made is performed when the 
data of the packet having the sequence number indi- 
cated by the retransmission request from the receiving 
end is stored in the retransmission buffer and there is 
matching in the number of retransmission times 

35 between the packet for which the retransmission 
request is made and the packet which is stored in the 
buffer and has the identical sequence number. Then, 
the number of retransmission times of the retransmitted 
packet in the retransmission buffer is incremeted. 

40 [0108] Hereinafter, a specific construction for 
embedding the number of retransmission times (herein- 
after also referred to as retransmission count) in the 
subsequent packets will be described as a fourth 
embodiment of the invention. 

45 

[Embodiment 4] 

[01 09] Figures 10-15 are diagrams for explaining a 
data transmission method according to a fourth embod- 

so iment of the present invention. 

[0110] Figure 10 is a block diagram illustrating a 
data transmission apparatus 104 in a data transmission 
system which performs real-time data transmission by 
the data transmission method according to the fourth 

55 embodiment. 

[0111] The data transmission apparatus 104 
includes a sequence number/retransmission count stor- 
age unit 35, a sequence number/retransmission count 
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insertion unit 34, and a retransmission count clear unit 
38. The sequence number/retransmission count stor- 
age unit 35 stores the sequence numbers and the 
retransmission counts, of the packets the priorities of 
which are equal to or higher than a predetermined 5 
value, amongst the packets transmitted by the transmis- 
sion unit 13a. The sequence number/retransmission 
count insertion unit 34 outputs the sequence number 
and the retransmission count which are stored in the 
storage unit 35, to the transmission unit 13a, such that w 
these data are inserted in the header of the packet to be 
transmitted. The retransmission count clear unit 38 sub- 
jects the packet received at the receiving unit 1 1 to a 
process of clearing the retransmission count, and out- 
puts the packet to the transmission queue management 75 
unit 12. Further, the transmission unit 13a of this fourth 
embodiment is different in function from the transmis- 
sion unit 13 of the first embodiment only in that it inserts 
the sequence number and the retransmission count 
supplied from the sequence number/retransmission 20 
count insertion unit 34 into the header of the packet sup- 
plied from the transmission queue management unit 12 
and then transmits this packet. 

[01 1 2] The data transmission apparatus 1 04 further 
includes a sequence number/retransmission count 25 
comparison unit 36 which receives the retransmission 
instruction received by the retransmission instruction 
receiving unit 14 (i.e.. the sequence number and 
retransmission count of the packet to be retransmitted) 
through the reproduction decision unit 16a, and com- 30 
pares the sequence number of the packet for which the 
retransmission request has been made with the 
sequence numbers of the packets stored in the retrans- 
mission buffer 1 7. Further, it compares the retransmis- 
sion count of the packet for which the retransmission 35 
request has been made with the retransmission count of 
the packet which is stored in the retransmission buffer 
17 and has the sequence number indicated by the 
retransmission request. 

[0113] In the data transmission apparatus 104, the 40 
retransmission decision unit 16a decides retransmis- 
sion of packets as follows, in accordance with the output 
from the comparison unit 36. To be specific, when the 
sequence number of the rearmost packet which has 
been received most recently is larger than the sequence 45 
number of the error packet, it is decided that selective 
retransmission should be performed on the error 
packet. On the other hand, when the sequence number 
of the rearmost packet is smaller than the sequence 
number of the error packet, it is decided that selective so 
retransmission should be performed on a packet having 
a sequence number which is larger than the sequence 
number of the rearmost packet and equal to or smaller 
than the sequence number of the error packet. Further, 
the retransmission buffer 17a outputs the packet to be 55 
retransmitted, to the transmission queue management 
unit 1 2, in accordance with the result of the decision in 
the retransmission propriety decision unit 16a. 



[0114] In figure 10, the sequence number/retrans- 
mission count increment unit increments the retrans- 
mission count (number of retransmission times) of the 
packet in the retransmission buffer 17a. which packet is 
decided to be retransmitted by the retransmission deci- 
sion unit 16a. 

[0115] Other constituents of the data transmission 
apparatus 104 are identical to those of the data trans- 
mission apparatus of the first embodiment. 
[0116] Figure 11 is a block diagram illustrating a 
data receiving apparatus 204 in the data transmission 
system which performs the real-time data transmission 
according to the data transmission method of the fourth 
embodiment. 

[0117] The data receiving unit 204 of this fourth 
embodiment includes a retransmission instruction out- 
put unit 26a, instead of the retransmission instruction 
output unit 26 of the data receiving apparatus 203 
according to the modification of the third embodiment. 
The retransmission instruction output unit 206a outputs 
a retransmission instruction which requests retransmis- 
sion of a packet, by using information in which the 
sequence number and retransmission count of this 
packet are paired. 

[0118] Other constituents of the data receiving 
apparatus 204 are identical to those of the data receiv- 
ing apparatus 203 according to the modification of the 
third embodiment. 

[0119] Next, the function and effect will be 
described. 

[01 20] Figure 12a sequence diagram for explaining 
packet selective retransmission control in the data 
transmission method of the fourth embodiment, illustrat- 
ing a first example of data exchange between the trans- 
mitting end and the receiving end. 
[0121] In the state shown in figure 12, the high pri- 
ority packet of sequence number S1 has already been 
received normally at the receiving end. Hereinafter, a 
packet having a sequence number Sn and retransmis- 
sion count N is represented as a packet (Sn.N) [n f N: 
natural numbers]. In the figure, packets of sequence 
numbers S1 , S2, and S4 are high priority packets, and 
packets of sequence numbers S3 and S5 are packets 
other than the high priority packets. In this fourth 
embodiment only the additional information of the 
above-mentioned high priority packets are embedded in 
the subsequent packets. 

[01 22] Initially, as shown in figure 1 2, at a predeter- 
mined transmission timing, the high priority packet 
(S2,1) subsequent to the high priority packet (S1) is 
retransmitted. At this time, in the header of the packet 
(S2.1). the sequence number S1 and retransmission 
count 1 of the high priority packet (S1) are embedded as 
well as its sequence number S2 and retransmission 
count 1. 

[0123] At the next transmission timing, the packet 
(S3) subsequent to the high priority packet (S2.1) is 
transmitted, having, in its header, the sequence number 
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S2 and retransmission count 1 of the high priority 
packet (S2.1) as well as its sequence number S3. 
[01 24] At the next transmission timing , the next high 
priority packet (S4.1) is retransmitted, having, in its 
header, the sequence number S2 and retransmission 
count 1 of the high priority packet (S2,1) as well as its 
sequence number S4 and retransmission count 1 
[0125] At the next transmission timing, the next 
packet (S5) is transmitted, having, in its header, the 
sequence number S4 and retransmission count 1 of the 
high priority packet (S4,1) as well as its sequence 
number S5. 

[0126] In the above-described four times of packet 
transmission, a transmission error has occurred during 
the first to third packet transmission and, therefore, the 
packets (S2.1), (S3), and <S4) are not received at the 
receiving end while only the packet (S5) is received. 
[0127] In this state, at the transmitting end, it is 
known that the high priority packet which has been 
received most recently is the packet having the 
sequence number S1 , and Ihe error packet is the packet 
having the sequence number S4 and the retransmission 
count 1 , but it is not known what kinds of packets have 
been transmitted between the high priority packet (S1) 
and the packet (S5). 

[0128] So. the receiving end sends a retransmis- 
sion request for the high priority packet (S4,1), together 
with the sequence number S1 of the most-recently 
received high priority packet as well as the sequence 
number S4 and retransmission count 1 of this packet 
(S4.1). 

[0129] TTien, at the transmitting end, the sequence 
number S1 of the most-recently received high priority 
packet is compared with the sequence number S4 of the 
error packet for which the retransmission request has 
been made. In this case, since the sequence number of 
the most-recently received high priority packet is 
smaller than the sequence number of the error packet, 
the transmitting end performs selective retransmission 
for those packets having sequence numbers larger than 
the sequence number S1 and equal to or smaller than 
the sequence number S4. 

[0130] In this case, the high priority packet (S2,2) is 
transmitted, having, in its header, the sequence number 
S4 and retransmission count 1 of the high priority 
packet (S4.1) and, subsequently, the high priority 
packet (S4,2) is transmitted, having, in its header, the 
sequence number S2 and retransmission count 2 of the 
high priority packet (S2,2). 

[0131] On receipt of the high priority packet (S2,2), 
the receiving end sends a retransmission request for 
the high priority packet (S4,1) toward the transmitting 
end, together with the sequence number S2 of the 
most-recently received high priority packet (S2,2) as 
well as the sequence number S4 and retransmission 
count 1 of this packet (S4,1). However, with respect to 
the high priority packet (S4), since the second retrans- 
mission has already been done, no retransmission is 



performed in response to the retransmission request for 
the high priority packet (S4.1). 

[01 32] Next, another example of data exchange will 
be described by using a sequence diagram of figure 13. 

5 [0133] In the case shown in figure 13, data 
exchange from transmission of the high priority packet 
(S2 f 1) to transmission of the high priority packet (S2.2) 
is identical to that described with respect to figure 12. 
[01 34] In the case shown in f igure 1 3 , transmission 

jo of the high priority packet (S2.2) is error transmission, 
and the next high priority packet (S4.2) is normally 
received. 

[01 35] In this case, at the receiving end, it is known 
that the high priority packet which has been received 
75 most recently has the sequence number S4, and the 
error packet has the sequence number S2 and the 
retransmission count 2. 

[0136] So, the receiving end sends a retransmis- 
sion request for the high priority packet (S2.2), together 
20 with the sequence number S4 of the most-recently 
received high priority packet as well as the sequence 
number S2 and retransmission count 2 of this packet 
(S2,2). 

[0137] Then, at the transmitting end, the sequence 
25 number S4 of the most-recently received high priority 
packet is compared with the sequence number S2 of the 
error packet for which the retransmission request has 
been made. In this case, since the sequence number 
S4 of the most-recently received high priority packet is 
so larger than the sequence number S2 of the error packet, 
the transmitting end performs selective retransmission 
for only the error packet. 

[0138] That is, the high priority packet (S2,3) is 
transmitted, having, in its header, the sequence number 
35 S4 and retransmission count 2 of the high priority 
packet (S4.2). 

[01 39] Next, still another example of data exchange 
will be described by using a sequence diagram of figure 
14. 

40 [0140] Initially, as shown in figure 1 4, at a predeter- 
mined transmission timing, the high priority packet 
(S4.1) is retransmitted, having, in its header, the 
sequence number S2 and retransmission count 1 of the 
high priority packet (S2.1) which has been transmitted 

45 in advance of this packet, as well as the sequence 
number S4 and retransmission count 1 of this packet. 
[0141] At the next transmission timing, the next 
packet (S5) is transmitted, having, in its header, the 
sequence number S4 and retransmission count 1 of the 

so high priority packet (S4.1) as well as the sequence 
number S5 of this packet. 

[0142] In this example, a transmission error has 
occurred during the first packet transmission, and so the 
packet (S4.1) is not been received at the receiving end 
55 while only the packet (S5) is received. 

[01 43] In this state, at the receiving end, it is known 
that the most-recently received high priority packet has 
the sequence number S1, and the error packet has the 
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sequence number S4 and the retransmission count 1 . 
[0144] So, the receiving end sends a retransmis- 
sion request for the high priority packet (S4.1), together 
with the sequence number S1 of the most-recently 
received high priority packet as well as the sequence s 
number S4 and retransmission count 1 of this packet. 
[0145] Then, at the transmitting end, the sequence 
number S1 of the most -recently received high priority 
packet is compared with the sequence number S4 of the 
error packet for which the retransmission request has w 
been made. In this case, since the sequence number 
S1 of the most-recently received high priority packet is 
smaller than the sequence number S4 of the error 
packet, the transmitting end performs selective retrans- 
mission for those packets having sequence numbers is 
larger than the sequence number S1 and equal to or 
smaller than the sequence number S4. 
[0146] In this case, the high priority packet (S2 t 2) is 
transmitted, having, in its header, the sequence number 
S4 and retransmission count 1 of the high priority 20 
packet (S4,1) as well as the sequence number S2 and 
retransmission count 2 of this packet (S2,2) and, subse- 
quently, the high priority packet (S4.2) is transmitted, 
having, in its header, the sequence number S2 and 
retransmission count 2 of the high priority packet (S2 ( 2) 25 
as well as the sequence number S4 and transmission 
count 2 of this packet. 

[0147] Thereafter, the packet of sequence number 
S6 is transmitted, having, in its packet, the sequence 
number S4 and retransmission count 2 of the high prior- 30 
ity packet (S4.2) as well as the sequence number S6 of 
this packet. 

[0148] Since errors have occurred during transmis- 
sion of the high priority packets (S2,2) and (S4.2), these 
packets are not received at the receiving end, and only 35 
the packet (S6) is received. 

[0149] In this state, at the receiving end, it is known 
that the most-recently received high priority packet has 
the sequence number S1, and the error packet has the 
sequence number S4 and the retransmission count 2. 40 
[0150] So, the receiving end sends a retransmis- 
sion request for the high priority packet (S4.2), together 
with the sequence number S1 of the most-recently 
received high priority packet as well as the sequence 
number S4 and retransmission count 2 of this packet. as 
[0151] Then, at the transmitting end, the sequence 
number S1 of the most-recently received high priority 
packet is compared with the sequence number S4 of the 
error packet for which the retransmission request has 
been made. In this case, since the sequence number so 
S1 of the most-recently received high priority packet is 
smaller than the sequence number S4 of the error 
packet, the transmitting end performs selective retrans- 
mission for those packets having sequence numbers 
which are larger than the sequence number S1 and 55 
equal to or smaller than the sequence number S4. 
[0152] That is, the high priority packet (S2,3) is 
transmitted, having, in its header, the sequence number 



S4 and retransmission count 2 of the high priority 
packet (S4.2) as well as the sequence number S2 and 
retransmission count 3 of this packet and, subsequently, 
the high priority packet (S4,3) is transmitted, having, in 
its header, the sequence number S2 and retransmission 
count 3 of the high priority packet (S2.3) as well as the 
sequence number S4 and retransmission count 3 of this 
packet. 

[0153] As described above, according to the fourth 
embodiment, when the sequence number of the most- 
recently received high priority packet is larger than the 
sequence number of the error packet, the transmitting 
end retransmits only the error packet. Therefore, 
retransmission of the error packet can be performed 
efficiently. 

[0154] In this fourth embodiment, emphasis has 
been placed on the case where one data receiving 
apparatus is provided for one data transmission appara- 
tus. However, the selective retransmission process of 
this fourth embodiment can be applied to multicast hav- 
ing a plurality of data receiving apparatuses for one data 
transmission apparatus. Hereinafter, a selective 
retransmission process applicable to multicast will be 
described as a modification of the fourth embodiment. 

[Modification of Embodiment 4] 

[01 55] Figure 1 5 is a sequence diagram for explain- 
ing a data transmission method according to a modifica- 
tion of the fourth embodiment, illustrating an example of 
selective retransmission in the case where a plurality of 
data receiving apparatuses are provided for one data 
transmission apparatus. 

[01 56] Initially, as shown in tigure 1 5, at a predeter- 
mined transmission timing, the high priority packet 
(S1.1) is transmitted, having, in its header, the 
sequence number and retransmission count of a previ- 
ous high priority packet as well as the sequence number 
S1 and retransmission count 1 of this packet. In this 
case, there are two receiving ends for the transmitting 
end. i.e., the receiving end I and the receiving end II, 
and transmission of the high priority packet (S1,1) is 
error transmission. 

[0157] In this case, each receiving end sends a 
retransmission request for the high priority packet 
(S1.1), together with the sequence number (lastS) of 
the most-recently received high priority packet. 
[0158] In response to the retransmission request 
from the receiving end I, the transmitting end retrans- 
mits the high priority packet (S1.2). However, after this 
retransmission, the transmitting end does not perform 
retransmission in response to the retransmission 
request from the receiving end II, because the high pri- 
ority packet (S1,2) has already been retransmitted in 
response to the retransmission request from the receiv- 
ing end II. 

[0159] As the result of the retransmission of the 
high priority packet (S1,2), the receiving end I receives 
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the high priority packet (S1) while the receiving end II 
does not receive the high priority packet (S1). 
[0160] In this case, the receiving end II outputs a 
retransmission request for the high priority packet 
(S1 ,2). In response to this request, the transmitting end s 
increments the retransmission count and retransmits 
the high priority packet (S1 ,3). 
[0161] In the fourth embodiment and the modifica- 
tion thereof, an upper limit may be set for the retrans- 
mission count- Further, the upper limit of the 10 
retransmission count may be changed according to the 
priority value of the packet. 

[Embodiment 5] 

15 

[0162] Figures 16 and 1 7 are diagrams for explain- 
ing a data transmission method according to a fifth 
embodiment of the present invention. 
[0163] According to the data transmission method 
of this fifth embodiment, in the data transmission 20 
method of the first embodiment, absence of a sequence 
number is detected at the receiving end, and a retrans- 
mission request for a packet having the absent 
sequence number is made by using this sequence 
number. At the transmitting end, when the packet of the 25 
sequence number for which the retransmission request 
has been output from the receiving end is stored in the 
retransmission buffer 17, retransmission of this packet 
is performed- At the transmitting end, only high priority 
packets are stored in the retransmission buffer 17. 30 
[0164] Figures 16(a) and 16(b) are block diagrams 
illustrating a data transmission apparatus 105 and a 
data receiving apparatus 205, respectively, in a data 
transmission system which performs real-time data 
transmission by the data transmission method of this 35 
fifth embodiment. 

[0165] The data transmission apparatus 105 is 
identical in structure to the data transmission apparatus 
101 ot the first embodiment. The data receiving appara- 
tus 205 includes a receiving unit 21, an error packet 40 
detection unit 22, a packet decoding unit 23, and a 
reception history management unit 24, like the data 
receiving apparatus 201 of the first embodiment. The 
receiving unit 21 receives packets transmitted from a 
relay server (data transmission apparatus at the trans- 45 
mitting end). The error packet detection unit 22 detects 
an error packet in which an error has occurred during 
transmission, in accordance with the output from the 
receiving unit 21, and outputs a normal packet which 
has been transmitted without a transmission error. The so 
packet decoding unit 23 receives the normal packet to 
decode coded data of the normal packet The reception 
history management unit 24 manages the reception his- 
tory of packets 

[01 66] The data receiving apparatus 205 of this fifth 55 
embodiment has a retransmission instruction output 
unit 26b which outputs a retransmission request for a 
packet corresponding to the absent sequence number 



detected by the error packet detection unit 22, instead of 
the retransmission instruction output unit 26 of the data 
receiving apparatus 201 of the first embodiment. 
[0167] Next, the function and effect will be 
described. 

[01 68] Figure 1 7 is a sequence diagram for explain- 
ing packet selective retransmission control in the data 
transmission method of this fifth embodiment. 
[0169J When a high priority packet (S1) of 
sequence number S1 , which has been output from the 
data transmission apparatus (transmitting end) 105, is 
not received by the data receiving apparatus (receiving 
end) 205 due to a transmission error, in the data receiv- 
ing apparatus 205, the error packet detection unit 22 
detects that the sequence number S1 is absent, and a 
retransmission request for the packet of this sequence 
number S1 is output to the transmitting end. 
[01 70] At the transmitting end, it is decided whether 
the packet of the retransmission request is stored in the 
retransmission buffer 17 or not. In this case, since the 
packet of the retransmission request is a high priority 
packet, it is stored in the retransmission buffer 17. 
Therefore, the transmitting end performs retransmission 
of this packet. 

[0171] Further, when a packet (S2) of sequence 
number S2, which has been output from the data trans- 
mission apparatus (transmitting end) 105, is not 
received by the data receiving apparatus (receiving 
end) 205 due to a transmission error, in the data receiv- 
ing apparatus 205, the error packet detection unit 22 
detects that the sequence number S2 is absent, and a 
retransmission request for the packet of this sequence 
number S2 is output to the transmitting end. 
[01 72] At the transmitting end, it is decided whether 
the packet of the retransmission request is stored in the 
retransmission buffer 17 or not. In this case, since the 
packet of the retransmission request is not a high prior- 
ity packet, it is not stored in the retransmission buffer 1 7. 
Therefore, the transmitting end does not perform 
retransmission of this packet. 

[0173] As described above, according to the fifth 
embodiment of the invention, the receiving end detects 
the absence of sequence number, and instructs the 
transmitting end to retransmit the packet of the absent 
sequence number by using this sequence number. 
Then, the transmitting end retransmits the packet of the 
sequence number indicated by the instruction from the 
receiving end when this packet is stored in the retrans- 
mission buffer. Therefore, the transmission quality in the 
wireless section in real-time transmission can be 
improved and, furthermore, the number of retransmis- 
sion times can be reduced. 

[Embodiment 6] 

[01 74] Figures 1 8-20 are diagrams for explaining a 
data transmission method according to a sixth embodi- 
ment of the present invention. 
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[0175] tn the data transmission method of this sixth 
embodiment, data transmission from the transmitting 
end to the receiving end is continuously performed in 
units of packets each having additional information 
relating to its sequence number, priority, and data repro- 
duction time and, simultaneously, data in the packets 
received at the receiving end are successively repro- 
duced. At this time, only the packet which can arrive at 
the receiving end within the time limit is retransmitted. 
[0176] Figure 18 is a block diagram illustrating a 
data transmission apparatus 106 in a data transmission 
system which performs real-time data transmission by 
the data transmission method of this sixth embodiment. 
[0177] This data transmission apparatus 106 con- 
stitutes a relay server (transmitting end) which relays 
data transmitted between a distribution server and a ter- 
minal 9 (receiving end). The data transmission appara- 
tus 106 includes a reproduction time decision unit 39. in 
addition to the constituents of the data transmission 
apparatus 101 of the first embodiment. The reproduc- 
tion time decision unit 39 decides a packet which cannot 
arrive at the receiving end within the reproduction time, 
amongst the packets to be transmitted. In the transmis- 
sion unit 13b, the packet decided in the reproduction 
time decision unit 39 is not transmitted to the receiving 
end whether it is stored in the retransmission buffer 17 
or not. 

[0178] Other constituents of the data transmission 
apparatus 106 are identical to those of the data trans- 
mission apparatus 101 of the first embodiment. 
[0179] Figure 19 is a block diagram illustrating a 
data receiving apparatus 206 in the data transmission 
system which performs real-time data transmission 
according to the data transmission method of the sixth 
embodiment. 

[0180] The data receiving apparatus 206 includes a 
reproduction time decision unit 43, instead of the packet 
priority decision unit 25 of the data receiving apparatus 
201 of the first embodiment. The reproduction time deci- 
sion unit 43 detects the reproduction time which is given 
to the error packet detected by the error packet detec- 
tion unit 22 and the arrival time of the error packet at the 
receiving end, decides the arrival time limit based on the 
reproduction time, and decides whether or not the error 
packet has arrived at the receiving end before the arrival 
time limit. On the basis of the result of the decision, the 
retransmission instruction output unit 26 instructs the 
transmitting end to retransmit the error packet which 
has arrived at the receiving end before the arrival time 
limit, by using the sequence number of the packet. The 
decision of the arrival time limit by the reproduction time 
decision unit 43 is performed based on at least one of 
the allowable packet delay time which is decided at the 
receiving end, and the packet transmission delay time 
between the transmitting end and the receiving end. 
[0181] Other constituents of the data receiving 
apparatus 206 are identical to those of the data receiv- 
ing apparatus 201 of the first embodiment. 



[01 82] As for the method of deciding the arrival time 
limit, it will be described in detail as an eighth embodi- 
ment of the present invention. 
[0183] Next, the function and effect will be 
5 described. 

[0184] Figure 20 is a sequence diagram for explain- 
ing packet retransmission control with time limit, in the 
data transmission method according to this sixth 
embodiment. 

w [0185] In the data transmission apparatus (trans- 
mitting end) 106, each packet to be transmitted is given 
a reproduction time at the receiving end. 
[01 86] For example, when high priority packets (S1 ) 
and (S2) having sequence numbers S1 and S2, which 

75 have been transmitted from the data transmission appa- 
ratus (transmitting end) 106, are not normally received 
at the data receiving apparatus (receiving end) 206 due 
to a transmission error, in the data receiving apparatus 
206, the error packet detection unit 22 decides that 

20 these high priority packets (S1 ) and (S2) are error pack- 
ets. Further, the reproduction time decision unit 43 
detects the reproduction times (T1) and (T2) and the 
arrival times of these error packets, decides the arrival 
time limits (T1+a) and (T2+a) in accordance with the 

25 reproduction times, and decides whether or not these 
error packets have arrived at the receiving end before 
the arrival time limits, respectively. 
[0187] Since the high priority packet (S1) has 
arrived at the receiving end before the time limit, the 

30 transmitting end instructs the transmitting end to 
retransmit this packet. 

[0188] On the other hand, since the high priority 
packet (S2) has not arrived at the receiving end before 
the time limit, the receiving end does not instruct the 

35 transmitting end to retransmit this packet. 

[0189] In the data transmission apparatus 106, 
when the data of the packet having the sequence 
number indicated by the retransmission request from 
the receiving end, is stored in the retransmission buffer, 

40 the data of the packet the transmission time of which 
does not pass the reproduction time is retransmitted to 
the receiving end. On the other hand, as for the data of 
the packet the transmission time of which has passed 
the reproduction time, this data is discarded without 

45 being transmitted, and the data in the retransmission 
buffer is discarded successively from the packet which 
cannot arrive at the receiving end within the data repro- 
duction time. 

[0190] As described above, according to the sixth 
so embodiment of the present invention, data transmission 
from the transmitting end to the receiving end is contin- 
uously performed in units of packets each having addi- 
tional information relating to its sequence number, 
priority, and data reproduction time at the receiving end 
55 and. simultaneously, data of the packets received at the 
receiving end are successively reproduced. At this time, 
only the packets which have arrived at the receiving end 
within the time limit at the receiving end. are retransmit- 
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ted to the transmitting end. Therefore, the transmission 
quality of wireless section in real-time transmission is 
improved and, moreover, the number of retransmission 
times can be reduced. 

[0191] While in this sixth embodiment emphasis 5 
has been placed on the method for recovering errors of 
data in packets, there is a case where additional infor- 
mation added to the packet header (i.e., the sequence 
number, the reproduction time, etc.) has an error. There 
are various methods of recovering the additional infor- 10 
mation as well as recovering the errors in data. Herein- 
after, these methods will be described as modifications 
of the sixth embodiment. 

[Modification 1 of Embodiment 6] is 

[0192] In a first modification of the sixth embodi- 
ment, in addition to the processes at the transmitting 
end and the receiving end in the data transmission 
method of the sixth embodiment, at the transmitting 20 
end, error correction codes for the sequence number 
and the reproduction time are given to the packet to be 
transmitted. At the receiving end, error correction for the 
sequence number and the reproduction time is per- 
formed by utilizing the error correction codes and, there- 25 
after, error packet retransmission control is performed 
on the basis of the decided arrival limit time. 
[0193] In the first modification of the sixth embodi- 
ment so constructed, even when the sequence number 
and the reproduction time of the error packet have w 
errors, these additional information can be corrected. 

[Modification 2 of Embodiment 6] 

[0194] In a second modification of the sixth embod- 35 
iment, in addition to the processes at the transmitting 
end and the receiving end in the data transmission 
method of the sixth embodiment, at the transmitting 
end, the sequence number and the reproduction time of 
a predetermined packet are embedded in a packet to be 40 
transmitted next. At the receiving end, the embedded 
information (i.e., the sequence number and the repro- 
duction time) of the previous packet (the predetermined 
packet) is extracted when the next packet is received. 
On the basis of this information, the arrival time limit of 45 
the predetermined packet is decided, and retransmis- 
sion control is performed for the predetermined packet 
as an error packet. 

[01 95) Figure 21isasequence diagram for explain- 
ing packet data retransmission control with time limit, in so 
a data communication system according to the second 
modification of the sixth embodiment. 
[0196] At the transmitting end, a predetermined 
packet is given the sequence number and the reproduc- 
tion time at the receiving end. and the sequence 55 
number and the reproduction time of this predetermined 
packet are also embedded in a next packet which is to 
be transmitted next to the predetermined packet. 



[0197] Thereafter, as shown in iigure 21, packets 
(S1) and (S2) of sequence numbers S1 and S2 are 
transmitted from the transmitting end, and the packet 
(S1) is not normally received at the receiving end due to 
a transmission error. Even in this case, as long as the 
packet (S2) is normally received at the receiving end, 
the receiving end can detect the sequence number S1 
and the reproduction time (T1) of the packet (S1) previ- 
ous to the packet (S2). 

[01 98] So, at the receiving end, the arrival time limit 
(Tl+a) is decided on the basis of the reproduction time 
(T1) of the error packet (S1), and it is decided whether 
or not the receiving end can receive the retransmitted 
packet within the arrival time limit if a retransmission 
request is made at this point of time. In this case, there 
is a possibility that the packet (S1) will arrive at the 
receiving end before the time limit if a retransmission 
request for the packet (S1) is made when receiving the 
packet (S2) and, therefore, the receiving end sends a 
retransmission request for the packet (S1) to the trans- 
mitting end. 

[0199] Thereafter, as shown in figure 21, packets 
(S3) and (S4) of sequence numbers S3 and S4 are 
transmitted from the transmitting end, and the packet 
(S3) is not normally received at the receiving end due to 
a transmission error. Even in this case, as long as the 
packet (4) is normally received at the receiving end. the 
receiving end can detect the sequence number S3 and 
the reproduction time (T3) of the packet (S3) previous to 
the packet (S4). 

[0200] So, at the receiving end, the arrival time limit 
(T3+a) is decided on the basis of the reproduction time 
(T3) of the error packet (S3), and it is decided whether 
the packet (S3) has arrived at the receiving end before 
the time limit or not. In this case, since the packet (S3) 
has not arrived at the receiving end before the time limit, 
the receiving end does not instruct the transmitting end 
to retransmit the packet (S3). 
[0201] In the second modification of the sixth 
embodiment so constructed, at the transmitting end. the 
sequence number and the reproduction time of a prede- 
termined packet are also embedded in a packet to be 
transmitted next to the predetermined packet. There- 
fore, even when errors occur in not only the data of the 
packet but also the sequence number and the reproduc- 
tion time, the receiving end can make a retransmission 
request for the error packet. Moreover, since the receiv- 
ing end does not make a retransmission request for the 
packet which cannot arrive at the receiving end within 
the reproduction time at the receiving end, the number 
of retransmission times can be reduced. 
[0202] As still another modification, the selective 
retransmission control according to any of the first to 
fifth embodiments and their modifications may be com- 
bined with the time-limit retransmission control accord- 
ing to any of the sixth embodiment and its modifications. 
[0203] For example, the second embodiment in 
which each packet is given error correction codes for its 
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sequence number and priority information may be com- 
bined with the first modification of the sixth embodiment 
in which each packet is giyen error correction codes for 
its sequence number and reproduction time (first combi- 
nation). According to this combination, each packet is 
given error correction codes for its sequence number, 
priority information, and reproduction time. 
[0204] Further, the third embodiment in which the 
sequence number and the priority information of a pre- 
determined packet are embedded in a packet to be 
transmitted next to the predetermined packet, may be 
combined with the second modification of the sixth 
embodiment in which the sequence number and the 
reproduction time of a predetermined packet are 
embedded in a packet to be transmitted next to the pre- 
determined packet (second combination). According to 
this combination, the sequence number, the priority 
intonation, and the reproduction time of the predeter- 
mined packet are embedded in the packet to be trans- 
mitted next to the predetermined packet. 
[0205] Further, the modification of the third embod- 
iment in which the process of embedding the sequence 
number and the priority information of a high priority 
packet to be transmitted into subsequent packets is 
continued until a next high priority packet is transmitted, 
may be combined with the second modification of the 
sixth embodiment in which the sequence number and 
the reproduction time of a predetermined packet are 
embedded in a packet to be transmitted next to the pre- 
determined packet (third combination). According to this 
combination, the process of embedding the sequence 
number, the priority information, and the reproduction 
time of a high priority packet into subsequent packets is 
continued until a next high priority packet is transmitted. 
[0206] Furthermore, according to the combination 
of the selective retransmission control and the retrans- 
mission control with time limit (second or third combina- 
tion), the quantity of data to be embedded in the packet 
increases- Therefore, there is proposed a method of 
embedding a difference between the header informa- 
tion (sequence number, priority information, reproduc- 
tion lime) of a predetermined packet and the header 
information of a subsequent packet, in the subsequent 
packet. 

[0207] Hereinafter, this method will be described as 
a third modification of the sixth embodiment. 

[Modification 3 of Embodiment 6] 

[0208] Figure 22 is a sequence diagram for explain- 
ing packet retransmission control with time limit, in the 
data transmission method according to a third modifica- 
tion of the sixth embodiment 

[0209] At the transmitting end, in a packet to be 
transmitted next to a predetermined packet, difference 
information relating to the sequence number and the 
reproduction time of the predetermined packet which 
has previously been transmitted is embedded together 



with the sequence number and the reproduction time of 
this packet. This difference information is composed of 
a difference between the sequence number of the pre- 
determined packet and the sequence number of the 
5 next packet (sequence difference) and a difference 
between the reproduction time of the predetermined 
packet and the reproduction time of the next packet 
(time difference). 

[0210] For example, as shown in figure 22, packets 
w (S1) and (S2) of sequence numbers S1 and S2 are 
transmitted from the transmitting end, and the packet 
(Si) is not normally received at the receiving end due to 
transmission error. Even in this case, as long as the 
packet (S2) is normally received at the receiving end, 
15 the receiving end can obtain the sequence number S1 
and the reproduction time (T1) of the packet (S1) previ- 
ous to the packet (S2). 

[0211] That is, the sequence number S1 of the 
packet (S1) can be obtained by subtracting the 
20 sequence difference (S2-S1) from the sequence 
number S2 of the packet (S2). Further, the reproduction 
time (T1) of the packet (S1) can be obtained by sub- 
tracting the difference time (T2-T1) from the reproduc- 
tion time (T2) of the packet (S2) 

25 [0212] Therefore, at the receiving end, the arrival 
time limit (T1+ a) is decided on the basis of the repro- 
duction time (T1) of the error packet (S1). and it is 
decided whether this packet has arrived at the receiving 
end before the arrival time limit or not. For example, 

30 when the packet (St) has arrived at the receiving end 
before the arrival time limit, the receiving end instructs 
the transmitting end to retransmit the packet (S1), by 
using the sequence number S1. 
[0213] In the third modification of the sixth embodi- 

35 ment so constructed, since a difference between the 
header information (sequence number, priority informa- 
tion, reproduction time) of a predetermined packet and 
the header information of a subsequence packet is 
embedded in the subsequence packet, the quantity of 

40 information to be embedded in the packet is reduced. 
[0214] While in the third modification of the sixth 
embodiment the sequence number and the reproduc- 
tion time are described as information to be embedded 
in the subsequent packet, information to be embedded 

45 is not restricted thereto. For example, in addition to the 
sequence number and the reproduction time, the 
retransmission count and the priority may be embed- 
ded. 

[0215] Hereinafter, a description will be given of 
50 embodiments relating to application sections of the 
retransmission control of the data transmission meth- 
ods according to the aforementioned embodiments. 

[Embodiment 7] 

55 

[0216] In a data transmission method according to 
a seventh embodiment of the invention, data transmis- 
sion between a distribution server and a terminal is per- 
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formed in packet units through a relay server and, at the 
terminal end, data of received packets are successively 
reproduced. When a transmission error occurs between 
the relay server and the terminal, the relay server per- 
forms retransmission of the error packet in accordance 
with a retransmission request from the terminal. When a 
transmission error occurs between the distribution 
server and the relay server, the distribution server per- 
forms retransmission of the error packet in accordance 
with a retransmission request which is transmitted from 
the terminal through the relay server. 
[021 7] Figure 23 is a block diagram tor explaining a 
data transmission method according to this seventh 
embodiment, illustrating a data transmission apparatus 
1 07 in a system performing data transmission according 
to the data transmission method. 
[0218] This data transmission apparatus 107 con- 
stitutes a relay server (transmitting end) which relays 
data transmitted between the distribution server and the 
terminal (receiving end), and it includes a retransmis- 
sion instruction output unit 51, in addition to the constit- 
uents of the data transmission apparatus 1 01 of the first 
embodiment The retransmission instruction output unit 
51 instructs the distribution server to retransmit an error 
packet for which a retransmission request has been out- 
put from the terminal, on the basis of the result of deci- 
sion in the retransmission propriety decision unit 16 
Other constituents of the data transmission apparatus 
1 07 are identical to those of the data transmission appa- 
ratus 101 of the first embodiment. 
[0219] Next, the function and effect will be 
described. 

[0220] In the seventh embodiment so constructed, 
when data transmission between the distribution server 
and the terminal is performed in packet units, the data 
transmission apparatus 107 relays data between the 
distribution server and the terminal. 
[0221] When a transmission error occurs between 
the relay server (data transmission apparatus 107) and 
the terminal, the relay server performs retransmission of 
the error packet. In this case, a retransmission request 
for the error packet from the terminal is not relayed to 
the distribution server. 

[0222] Further, when a transmission error occurs 
between the distribution server and the relay server 
(data transmission apparatus 107), a retransmission 
request for the error packet from the terminal is trans- 
mitted to the distribution server, and the error packet 
which is retransmitted from the distribution server is 
relayed by the data transmission apparatus 107 to be 
transmitted to the terminal 

[0223] In the seventh embodiment so constructed, 
when a transmission error occurs between the relay 
server (the data transmission apparatus) and the termi- 
nal, a retransmission request for the error packet from 
the terminal is not relayed to the distribution server, and 
the relay server performs retransmission of the error 
packet. Therefore, the number of retransmission times 



between the distribution server and the relay server can 
be reduced. 

[Modification of Embodiment 7] 

5 

[0224] A modification of the seventh embodiment is 
a data transmission method in which data transmission 
between a distribution server and a terminal is per- 
formed in packet units through a relay server and, at the 

w terminal end, data of received packets are successively 
reproduced. When a transmission error occurs between 
the distribution server and the relay server, the error 
packet is not transmitted to the terminal, but the relay 
server transmits a retransmission request to the distri- 

15 bution server and the error packet is retransmitted from 
the distribution server to the relay server. 
[0225] Figure 24 is a block diagram illustrating a 
data transmission apparatus 107a in a data communi- 
cation system according to the modification of the sev- 

20 enth embodiment. 

[0226] The data transmission apparatus 107a con- 
stitutes a relay server (transmitting end) which relays 
data transmitted between a distribution server and a ter- 
minal (receiving end), and it includes an error packet 

25 decision unit 22, a reception history management unit 
52, and a retransmission instruction output unit 51a, in 
addition to the constituents of the data transmission 
apparatus 101 of the first embodiment. The error packet 
decision unit 22 decides whether each packet received 

30 is an error packet or not on the basis of the output from 
the receiving unit 1 1 which receives packets from the 
distribution server, and outputs normally received pack- 
ets. The reception history management unit 52 man- 
ages the history of the normally received packets. The 

35 retransmission instruction output unit 51a instructs the 
distribution server to retransmit the error packet, 
according to the result of the decision in the retransmis- 
sion decision unit 16, the result of the detection in the 
error packet detection unit 22, and the contents of the 

40 reception history in the reception history management 
unit 52. Other constituents of the data transmission 
apparatus 107a are identical to those of the data trans- 
mission apparatus 101 of the first embodiment. 
[0227] Next, the function and effect will be 

45 described. 

[0228] In the modification of the seventh embodi- 
ment so constructed, when data transmission between 
the distribution server and the terminal is performed in 
packet units, the data transmission apparatus 107a 

50 relays the data between the distribution server and the 
terminal- 

[0229] When a transmission error occurs between 
the relay server (data transmission apparatus 107a) 
and the terminal, the relay server performs retransmis- 
55 sion of the error packet. In this case, a retransmission 
request for the error packet from the terminal is not 
relayed to the distribution server. 
[0230] Further, when a transmission error occurs 
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between the distribution server and the relay server 
(data transmission apparatus 107a), the error packet is 
not transmitted to the terminal, but a retransmission 
request from the relay server is transmitted to the distri- 
bution server and the error packet is retransmitted from 
the distribution server to the relay server. 
[0231] Then, the relay server transmits the error 
packet retransmitted from the distribution server, to the 
terminal 

[0232] In the modification of the seventh embodi- 
ment, when a transmission error occurs between the 
distribution server and the relay server, the error packet 
is not transmitted to the terminal, but the relay server 
outputs a retransmission request to the distribution 
server and thereby the distribution server retransmits 
the error packet to the relay server. Therefore, wasteful 
transmission of the error packet from the relay server to 
the terminal is avoided. 

[Embodiment 8] 

[0233] Figures 25-27 are diagrams for explaining a 
data transmission method according to an eighth 
embodiment of the present invention. 
[0234] In this data transmission method, data trans- 
mission between a distribution server and a terminal is 
performed in packet units and. at the terminal end. data 
of received packets are successively reproduced. Fur- 
ther, information about a reproduction delay time which 
is allowable for the data reproduction time at the termi- 
nal end, is transmitted from the terminal to the distribu- 
tion server. In the distribution server, the reproduction 
time at the terminal is estimated on the basis of the 
reproduction delay time and the transmission delay time 
which is required for data transmission between the dis- 
tribution server and the terminal. 
[0235] Figure 25 is a block diagram illustrating a 
data transmission apparatus 108 in a data communica- 
tion system according to this eighth embodiment of the 
invention. 

[0236] This data transmission apparatus 108 con- 
stitutes a relay server (transmitting end) which relays 
data transmission between a distribution server and a 
terminal (receiving end), and it includes a receiving unit 
11 , a transmission queue management unit 1 2, and a 
transmission unit 13. The receiving unit 11 receives 
packets transmitted from the distribution server. The 
transmission queue management unit 12 sets the trans- 
mission order of the received packets, in accordance 
with additional information, such as a sequence 
number, which is given to each packet. The transmis- 
sion unit 13 transmits the packets in the transmission 
order which is set by the unit 12. 
[0237] The data transmission apparatus 1 08 further 
includes a time stamp extraction unit 75 and an allowa- 
ble reproduction delay information receiving unit 72, 
The time stamp extraction unit 75 extracts a time stamp 
which is given to each packet as time information, 



through the transmission unit 13. The allowable repro- 
duction delay information receiving unit 72 receives 
information relating to the allowable reproduction delay 
time (arrival time limit) from the receiving end (terminal). 

5 [0238] Further, the data transmission apparatus 
108 includes a transmission delay measurement packet 
transmitting and receiving unit 71, and a transmission 
delay measurement unit 73. The transmission delay 
measurement packet transmitting and receiving unit 71 

w performs transmission and reception of a packet used 
for measuring a transmission delay (transmission delay 
measurement packet). The transmission delay meas- 
urement unit 73 measures a transmission delay in 
accordance with the time required for forward and back- 

is ward transmission of the transmission delay measure- 
ment packet between the transmitting end and the 
receiving end. 

[0239] Further, the data transmission apparatus 
108 includes a reproduction time calculation unit 74 

20 which estimates the data reproduction time at the 
receiving end, in accordance with the transmission 
delay, the time stamp, and the allowable reproduction 
delay time (arrival time limit), and outputs the estimated 
reproduction time. 

25 [0240] Furthermore, like the data transmission 
apparatus according to embodiment 1 or 6. the data 
transmission apparatus 108 has the function of storing a 
packet the priority of which is equal to or higher than a 
predetermined value in a retransmission buffer and dis- 

30 carding a packet which cannot be in the time for retrans- 
mission, and the function of retransmitting a packet for 
which a retransmission request is output from the 
receiving end, although these functions are not shown 
in the figure. 

35 [0241 ] To be specific, the data transmission appara- 
tus 108 includes the constituents corresponding to the 
retransmission instruction receiving unit 14, the packet 
priority decision unit 15, the retransmission decision 
unit 16, the retransmission buffer 17, and the retrans- 

40 mission buffer management unit 18 which are included 
in the data transmission apparatus 101 of the first 
embodiment. In the transmission queue management 
unit 12, setting of the packet transmission order is per- 
formed on all the packets to be transmitted, including 

45 not only the received packets but also the packets to be 
transmitted. 

[0242] Figure 26 is a block diagram illustrating a 
data receiving apparatus 208 in the data transmission 
system which performs real-time data transmission by 
so the data transmission method according to this eighth 
embodiment. 

[0243] The data receiving apparatus 208 includes a 
receiving unit 21 which receives packets transmitted 
from the relay server (data transmission apparatus at 
55 the transmitting end), and a packet decoding unit 23 
which decodes the received packets. 
[0244] The data receiving apparatus 208 further 
includes a transmission delay measurement packet 
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transmitting and receiving unit 62, an allowable repro- 
duction delay decision unit 63, and an allowable repro- 
duction delay information transmitting unit 61. The 
transmission delay measurement packet transmitting 
and receiving unit 62 receives the transmission delay 5 
measurement packet which has been transmitted from 
the transmission delay measurement packet transmit- 
ting and receiving unit 71 at the transmitting end, and 
returns it to the transmitting end. The allowable repro- 
duction delay decision unit 63 decides an allowable w 
reproduction delay time, and outputs information relat- 
ing to this. The allowable reproduction delay information 
transmitting unit 61 transmits the information relating to 
the allowable reproduction delay time, to the transmit- 
ting end. 15 
[0245] Furthermore, like the data receiving appara- 
tuses according to embodiments 1 and 6, the data 
receiving apparatus 208 has the function of detecting 
error packets and outputting a retransmission request 
for an error packet which can be in the time for retrans- 
mission, although this is not shown in the figure. 
[0246] To be specific, the data receiving apparatus 
208 includes the constituents corresponding to the error 
packet detection unit 22. the reception history manage- 
ment unit 24, the packet priority decision unit 25, and 
the retransmission instruction output unit 26 which are 
included in the data receiving apparatus 201 of the f irst 
embodiment. 

[0247] Next, the function and effect will be 
described. 

[0248] Figures 27(a) and 27(b) are diagrams for 
explaining a method for estimating the data reproduc- 
tion time at the terminal, in the server according to this 
eighth embodiment. More specifically, figure 27(a) 
shows the relationship between the packet time stamp 
and the packet output time (reproduction time) or the 
like, and figure 27(b) shows a method for mapping the 
time stamp to the standard time. 
[0249] In the data transmission apparatus (trans- 
mitting end) 108, when the transmission unit 13 per- 
forms packet transmission in accordance with the 
transmission order which is set by the transmission 
queue management unit 12, the time stamp tp included 
in each packet is extracted by the time stamp extraction 
unit 75, and output to the reproduction time calculation 
unit 74. Further, the allowable reproduction delay time 
dp which is decided by the decision unit 63 of the data 
receiving apparatus (receiving end) 208 and transmitted 
through the transmission unit 61, is received by the 
allowable reproduction delay information receiving unit 
72 and output to the reproduction time calculation unit 
74. Further, the transmission delay measurement 
packet is transmitted from the transmission delay meas- 
urement packet transmitting and receiving unit 71 at the 
transmitting end to the transmission delay measure- 
ment packet transmitting and receiving unit 62 at the 
receiving end, and the transmission delay measure- 
ment packet is returned from the transmitting and 



receiving unit 62 at the receiving end to the transmitting 
and receiving unit 72 at the transmitting end, whereby 
the server-to-terminal transmission delay d s is obtained 
by the transmission delay measurement unit 73 and out- 
put to the reproduction time calculation unit 74. The time 
when each packet is output from the server is measured 
at the transmitting end. 

[0250] Then, the reproduction time calculation unit 
74 estimates the reproduction time (packet output time) 
to of each packet at the receiving end. 
[0251] To be specific, as shown in figure 27(a), the 
packet output time t G is obtained by adding the allowable 
reproduction delay time d p to the time stamp tp, and the 
terminal reception time t r is obtained by adding the 
server-to-terminal transmission delay d s to the server 
output time t s . Accordingly, the reproduction time calcu- 
lation unit 74 obtains the packet output time to by (t p + 
d p ) and the terminal reception time t r by (t s + d s ). 
[0252] Thereafter, in the data transmission appara- 
tus 108, on the basis of comparison between (t s + d s ) 
and (t p + d p ), it is decided whether the transmission 
packet can arrive at the receiving end before the repro- 
duction time or not, i.e., whether the relationship, termi- 
nal reception time t r ^ packet output time t c , is satisfied 
or not. Based on the result of this decision, retransmis- 
sion of the error packet requested, and discard of the 
packet in the retransmission buffer are performed. 
[0253] While in this eighth embodiment the repro- 
duction delay d p is transmitted from the receiving termi- 
nal to the server, this may be a fixed value. Further, 
temporal synchronization between the server and the 
terminal is made by, for example, NTP (network time 
protocol) of Internet standard. 

[0254] Further, the time stamp t p of each packet is 
obtained from the time stamp of the RTP header, this 
time stamp value must be mapped onto the same time 
axis as the server output time or the like. 
[0255] Hereinafter, the RTP time stamp mapping 
method in the relay server will be described briefly. 
[0256] Since the RTP time stamp is not expressed 
directly by the standard time, it is mapped to time infor- 
mation based on the standard time, by using informa- 
tion included in other standard protocols RTCP (Real- 
Time Control Protocol) and RTSP (Real-Time Stream 
Protocol). The relay server (data transmission appara- 
tus ) 108 must know this mapping information and, 
therefore, the relay server 108 obtains this mapping 
information when it relays the mapping information. 
[0257] For example, as shown in figure 27(b), when 
the mapping information for the time stamps included in 
the Internet standard protocols RTCP and RTSP, which 
is output from the server S, is relayed by the relay server 
IS to the terminal T, the mapping information is analyzed 
by the relay server IS. Further, the mapping information 
for the time stamps at the terminal is transmitted from 
the terminal to the server. 

[0258] As described above, according to the eighth 
embodiment, since the server (data transmission appa- 
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ratus) estimates the actual output time (reproduction 
time) of each packet at the terminal, a packet which can- 
not be in time for reproduction can be eliminated from 
the retransmission buffer. 

[0259] In this eighth embodiment, the method for 5 
deciding the transmission delay time and the allowable 
reproduction delay time is not restricted to the above- 
mentioned method. For example, during data reproduc- 
tion at the receiving end, the transmission delay 
between the server and the terminal may be dynami- ™ 
cally updated according to the information from the 
receiving end Alternatively, during data reproduction at 
the receiving end, the allowable reproduction delay may 
be measured and changed dynamically. 
[0260] Furthermore, while in this eighth embodi- is 
ment the actual output time (reproduction time) of each 
packet at the terminal is estimated in the relay server 
(data transmission apparatus), it may be estimated in 
the distribution server in accordance with the allowable 
reproduction delay time from the terminal or the trans- 20 
mission delay time required for data transmission 
between the distribution server and the terminal 

[Embodiment 9] 

[0261] Figures 29-31 are diagrams for explaining a 
data transmission method according to a ninth embodi- 
ment of the present invention. In the data transmission 
method of this ninth embodiment, data transmission 
from the transmitting end to the receiving end is contin- 
uously performed in units of packets each having addi- 
tional information relating to its sequence number, 
priority, and data reproduction time at the receiving end, 
which are required to realize real-time transmission in 
packet units, while successively reproducing data of the 
packets received at the receiving end. At this time, only 
error packets the priorities of which are equal to or 
higher than a predetermined value are retransmitted. 
[0262] Figure 29(a) is a block diagram illustrating a 
data transmission apparatus 109 in a data transmission 
system which performs real-time data transmission 
according to the data transmission method of this ninth 
embodiment. 

[0263] The data transmission apparatus 109 consti- 
tutes a relay server (transmitting end) which relays data 
transmitted between a distribution server and a terminal 
(receiving end). The data transmission apparatus 109 
includes a receiving unit 1 1 , a transmission queue man- 
agement unit 12, and a transmission unit 13. The 
receiving unit 1 1 receives packets transmitted from the 
distribution server. The transmission queue manage- 
ment unit 12 sets the transmission order of the received 
packets and the packets to be retransmitted (retrans- 
mission packets) in accordance with the above- 
described additional information. The transmission unit 
13 transmits the packet data in the transmission order 
which has been set by the transmission queue manage- 
ment unit 12. 



[0264] The data transmission apparatus 109 further 
includes a high priority sequence number management 
unit 81, a sequence number correspondence manage- 
ment unit 82, and a high priority sequence number 
insertion unit 83. When the priority of a packet transmit- 
ted by the transmission unit 13 is equal to or higher than 
a predetermined value, the high priority sequence 
number management unit 81 increments the value of 
the sequence number which corresponds to only the 
high priority packet (high priority sequence number), 
and stores the incremented value. The sequence 
number correspondence management unit 82 stores 
the correspondence between the value of the sequence 
number of the transmitted high priority packet and the 
value of the incremented high priority sequence number 
of this high priority packet. The high priority sequence 
number insertion unit 83 outputs the value of the high 
priority sequence number of each high priority packet, 
which is stored in the management unit 81 , so that it is 
inserted in the packet to be transmitted. 
[0265] The high priority sequence numbers man- 
aged by the high priority sequence number manage- 
ment unit 81 correspond to the number of high priority 
packets transmitted from the transmitting end. 
[0266] Further, the data transmission apparatus 
109 includes a retransmission buffer 17, a packet prior- 
ity decision unit 15, and a retransmission buffer man- 
agement unit 18. The retransmission buffer 17 stores 
predetermined packets amongst the received packets, 
as retransmission packets. The packet priority decision 
unit 15 decides the priorities of the received packets. 
The retransmission buffer management unit 18 controls 
the retransmission buffer 1 7 such that data of packets 
the priorities of which are equal to or higher than a pre- 
determined value are stored in the buffer 17, in accord- 
ance with the decided priorities of the packets. 
[0267] Further, the data transmission apparatus 
109 includes a retransmission instruction receiving unit 
14 and a retransmission decision unit 16c. The retrans- 
mission instruction receiving unit 14 receives a retrans- 
mission request indicating a high priority sequence 
number, from the terminal at the receiving end. The 
retransmission decision unit 16c decides whether 
retransmission of a packet for which the retransmission 
request has been made is performed or not. The 
retransmission decision unit 16 retrieves the manage- 
ment information in the sequence number correspond- 
ence management unit 82. in accordance with the high 
priority sequence number indicated by the retransmis- 
sion request, to obtain the sequence number corre- 
sponding to the high priority sequence number used for 
the retransmission request, and decides that the 
requested packet is to be retransmitted, only when the 
packet of the sequence number is stored in the retrans- 
mission buffer 1 7. 

[0268] In figure 29(a), real-time data transmission is 
performed in packet units between the distribution 
server and the terminal through the relay server or the 
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like, and the data transmission apparatus 109 consti- 
tutes the relay server. However, the relay server may 
serve as the distribution server. To be specific, when the 
data transmission apparatus serves as the distribution 
server, it is constructed as shown in figure 29(b). In fig- 5 
ure 29(b), the receiving unit 1 1 of the data transmission 
apparatus 109 is replaced with a coded packet genera- 
tion unit 10a which encodes the data and outputs the 
coded data in packet units, and a priority allocation unit 
10b which allocates additional information, such as a io 
priority, to each packet output from the coded packet 
generation unit 1 0a. 

[0269] Figure 30 is a block diagram illustrating a 
data receiving apparatus 209 in the data transmission 
system which performs real-time data transmission 15 
according to the data transmission method of the ninth 
embodiment. 

[0270] The data receiving apparatus 209 includes a 
receiving unit 21, an error packet detection unit 22a, 
and a packet decoding unit 23. The receiving unit 21 20 
receives the packets transmitted from the data trans- 
mission apparatus at the transmitting end. The error 
packet detection unit 22a detects error packets in which 
errors have occurred during transmission, and outputs 
normal packets which have been transmitted without 25 
transmission errors. The packet decoding unit 23 
receives the normal packets and decodes the coded 
data of the normal packets. 

[0271] When the high priority sequence number 
inserted in the packet from the data transmission appa- 30 
ratus (transmitting end high priority sequence number) 
is correctly extracted, the error packet detection unit 22a 
outputs both of the value of the transmitting end high 
priority sequence number and the value of the receiving 
end high priority sequence number at this point of time. 35 
The value of the receiving end high priority number cor- 
responds to the number of the high priority packets 
received at the receiving end, and this value is incre- 
mented every time a high priority packet is received at 
the receiving end. 40 
[0272] Further, the data receiving apparatus 209 
includes a high priority sequence number management 
unit 91 and a retransmission sequence number decision 
unit 92. When the error packet detection unit 22a out- 
puts a normal packet, the high priority sequence 45 
number management unit 91 increments the value of 
the receiving end high priority sequence number and 
stores it. The retransmission sequence number deci- 
sion unit 92 compares the value of the transmitting end 
high priority sequence number output from the error bo 
packet detection unit 22a with the value of the receiving 
end high priority sequence number. When these values 
are not equal, the decision unit 92 outputs the values 
ranging from the value obtained by adding 1 to the value 
of the receiving end high priority sequence number to 55 
the value of the transmitting end high priority sequence 
number, as the values of retransmission sequence num- 
bers (transmitting end high priority sequence numbers). 



[0273] The high priority sequence number manage- 
ment unit 91 increments the value of the stored receiv- 
ing end high priority sequence number every time the 
retransmission sequence number decision unit 92 out- 
puts a high priority sequence number. 
[0274] Further, the data receiving unit 209 includes 
a retransmission instruction output unit 26c which out- 
puts a retransmission request for an error packet to the 
transmitting end, on the basis of the transmitting end 
high priority sequence number which is output as a 
retransmission sequence number from the retransmis- 
sion sequence number decision unit 92. 
[0275] Next, the function and effect will be 
described. 

[0276] Figure 31 is a sequence diagram for explain- 
ing the selective packet retransmission control in the 
data transmission method of this ninth embodiment. 
[0277] In the description with respect to figure 31 , a 
sequence number [S+n] indicates a sequence number 
having a value "S+n", a sequence number [H+n] indi- 
cates a high priority sequence number having a value 
"H+n", and a packet (S+n) indicates a packet having a 
sequence number the value of which is "S+n". Further, 
n is any of 0, 1 . 2, 3, 4, and 5. 

[0278] For example, assuming that the priorities 
equal to or higher than the predetermined value are 
high priorities while the priorities lower than the prede- 
termined value are low priorities, as shown in figure 31 . 
when an error has occurred during transmission of high 
priority packets (S+1) and (S+2) of sequence numbers 
[S+1] and [S+2], retransmission requests for these high 
priority packets are made at the receiving end. How- 
ever, when an error has occurred during transmission of 
a low priority packet (S+3) of sequence number [S+3], 
no retransmission request is made for this low priority 
packet (S+3). 

[0279] To be specific, each packet transmitted from 
the distribution server is given additional information 
relating to its sequence number and priority. In the data 
transmission apparatus 109 as a relay server, the trans- 
mission order of the received packets is set by the trans- 
mission queue management unit 12, and then the 
packets are supplied to the transmission unit 13. On the 
other hand, the priorities of the received packets are 
decided by the packet priority decision unit 15. Then, in 
the transmission unit 1 3, transmission of these packets 
is performed according to the transmission order which 
has been set. Further, those packets the priorities of 
which are decided as being equal to or higher than the 
predetermined value are stored in the retransmission 
buffer 17 under control of the retransmission buffer 
management unit 17. Further, in the retransmission 
buffer 17, data are successively released (discarded) 
from the packets which cannot be in tine for reproduc- 
tion, under control of the management unit 18. 
[0280] Next, a description will be given of manage- 
ment of the sequence numbers at the time of packet 
transmission. 
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[0281 ] When transmitting a high priority packet, the 
high priority sequence number is incremented. 
[0282] To be specific, when a high priority packet 
(S+0) of sequence number [S+0] is transmitted by the 
transmission unit 13, the value of the transmitting end 
high priority sequence number [H+0] which is stored in 
the high priority sequence number management unit 81 
is incremented to "H+r, At this time, the value of the 
sequence number [S+0] of the high priority packet (S+0) 
and the incremented value of the transmitting end high 
priority sequence number [H+1] are entered, by one-to- 
one correspondence, in the sequence number corre- 
spondence management unit 82. 
[0283] Likewise, when a high priority packet (S+1) 
of sequence number [S+1] is transmitted by the trans- 
mission unit 13, the value of the transmitting end high 
priority sequence number [H+1] which is stored in the 
high priority sequence number management unit 81 is 
incremented to "H+2\ At this time, the value of the 
sequence number [S+1] of the high priority packet (S+1) 
and the incremented value of the transmitting end high 
priority sequence number [H+2J are entered, by one-to- 
one correspondence, in the sequence number corre- 
spondence management unit 82. 
[0284] Further, also when a high priority packet 
(S+2) is transmitted, like the high priority packets (S+0) 
and (S+1), the transmitting end high priority sequence 
number [H+2] in the high priority sequence number 
management unit 81 is incremented, and the sequence 
number [S+2] of the high priority packet (S+2) and the 
incremented transmitting end high priority sequence 
number [H+3] are entered, by one-to-one correspond- 
ence, in the sequence number correspondence man- 
agement unit 82. 

[0285] On the other hand, when transmitting a low 
priority packet, the corresponding low priority sequence 
number is not incremented. 

[0286] To be specific, when a low priority packet 
(S+3) of sequence number [S+3] is transmitted by the 
transmission unit 13, the value of the transmitting end 
high priority sequence number [H+3] stored in the high 
priority sequence number management unit 81 is not 
updated but maintained as it is. At this time, the process 
of entering the sequence number of the transmitted 
packet and the transmitting end high priority sequence 
number [H+3] which is stored in the high priority 
sequence number management unit 81, in the 
sequence number correspondence management unit 
82, is not performed. 

[0287] Next, a description will be given of a 
sequence number embedding process at the time of 
packet transmission. 

[0288] When the high priority packet (S+1) is trans- 
mitted, the value of the transmitting end high priority 
sequence number [H+1] which is stored in the high pri- 
ority sequence number management unit 81 at this 
point of time, is embedded in the header of the trans- 
mission packet (S+1) by the high priority sequence 



number insertion unit 83. Likewise, when the low priority 
packet (S+3) is transmitted, the value of the transmitting 
end high priority sequence number [H+3] which is 
stored in the high priority sequence number manage- 

5 ment unit 81 at this point of time, is embedded in the 
header of the transmission packet (S+3) by the high pri- 
ority sequence number insertion unit 83. Thereafter, the 
transmission packet having the transmitting end high 
priority sequence number so embedded in its header, is 

io transmitted to the receiving end by the transmission unit 
13. 

[0289] Those packets output from the distribution 
server are successively transmitted to the terminal (data 
receiving apparatus) 209 through the relay server. 

15 [0290] In the data receiving apparatus 209, the 
packets from the relay server (data transmission appa- 
ratus) 109 are received by the receiving unit 21 , and the 
received packets are supplied to the error packet detec- 
tion unit 22a. The normally received high priority packet 

20 (S+0) is output from the error packet detection unit 22a 
to the packet decoding unit 23, and the value of its 
receiving end high priority sequence number (i.e., the 
value of the high priority sequence number [H+0] stored 
in the high priority sequence number management unit 

25 91) is incremented to tt H+1 

[0291 ] It is assumed that a transmission error has 
occurred during transmission of the high priority packets 
(S+1) and (S+2) and. thereafter, the low priority packet 
(S+3) subsequent to these packets has been transmit- 

30 ted without a transmission error. 

[0292] In this case, the normally transmitted low pri- 
ority packet (S+3) is output from the error packet detec- 
tion unit 22a to the packet decoding unit 23, but the 
value of the receiving end high priority sequence 

35 number [H+1] which is stored in the high priority 
sequence number management unit 91 is not incre- 
mented. 

[0293] Further, in the error packet detection unit 
22a, when the transmitting end high priority sequence 

40 numbers [H+Q] and [H+3] which are inserted in the high 
priority packet (S+0) and the low priority packet (S+3), 
respectively, are correctly extracted, these transmitting 
end high priority sequence numbers [H+0] and [H+3] 
are output to the retransmission sequence number deci- 

45 sion unit 92. Further, the receiving end high priority 
sequence numbers [H+0] and [H+1] which are stored in 
the high priority sequence number management unit 91 
at the time when the transmitting end high priority 
sequence numbers [H+0] and [H+3] are extracted by 

bo the error packet detection unit 22a, are output to the 
retransmission sequence number decision unit 92. 
[0294] For example, at the true when the transmit- 
ting end high priority sequence number [H+0] is 
extracted, the value [H+0] of the receiving end high pri- 

55 ority sequence number stored in the high priority 
sequence number management unit 91 as well as the 
transmitting end high priority sequence number [H+0] 
are output to the retransmission sequence number deci- 
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sion unit 92. At the time when the transmitting end high 
priority sequence number [H+3] is extracted, the value 
[H+1] of the receiving end high priority sequence 
number stored in the high priority sequence number 
management unit 91 as well as the transmitting end 
high priority sequence number [H+3] are output to the 
retransmission sequence number decision unit 92. 
[0295] In the retransmission sequence number 
decision unit 92, the transmitting end high priority 
sequence number and the receiving end high priority 
sequence number, which have been supplied at the 
same time, are compared, to decide whether retrans- 
mission is to be requested to the transmitting end. 
[0296] For example, as the result of the comparison 
between the transmitting end high priority sequence 
nuTtber [H+0] and the receiving end high priority 
sequence number [H+0], since the values of these high 
priority sequence numbers are equal, no transmission 
instruction is performed. On the other hand, as the 
result of the comparison between the transmitting end 
high priority sequence number [H+3] and the receiving 
end high priority sequence number [H+1], since the val- 
ues of these high priority sequence numbers are not 
eciiftl, a retransmission instruction is performed. In this 
Case, the values ranging from the value obtained by 
adding 1 to the value of the receiving end high priority 
sequence number [H+1] to the value of the transmitting 
end high priority sequence number [H+3], i.e., "H+2 n 
and "H+3", are output to the retransmission instruction 
output unit 26 as the values of the high priority 
sequence numbers used for the retransmission instruc- 
tion. At this time, in the high priority sequence number 
management unit 91 , the value of the stored receiving 
end high priority sequence number is incremented twice 
to be "H+3*\ 

[0297] On receipt of "H+2" and "H+3" as the values 
of the high priority sequence numbers, the retransmis- 
sion instruction output unit 26 outputs a retransmission 
request with the high priority sequence number [H+2] 
and a retransmission request with the high priority 
sequence number [H+3], to the transmitting end. 
[0298] Then, in the data transmission apparatus 
109 at the transmitting end, the retransmission requests 
are received by the retransmission instruction receiving 
unit 14, and the management information in the 
sequence number correspondence management unit 
82 is retrieved on the basis of the requested high priority 
sequence numbers [H+2] and [H+3], thereby obtaining 
the sequence number [S+1] corresponding to the high 
priority sequence number [H+2] and the sequence 
number [S+2] corresponding to the high priority 
sequence number [H+3] 

[0299] Further, in the retransmission decision unit 
16c, it is decided whether the data of the packets corre- 
sponding to the sequence numbers [S+1] and [S+2] are 
stored in the retransmission buffer 17 or not. Based on 
the result of this decision, only the packets the data of 
which are stored in the retransmission buffer 17 are out- 



put as retransmission packets from the retransmission 
buffer 17 to the transmission queue management unit 
12. Here, the high priority packets (S+1) and (S+2) are 
output as retransmission packets. 

5 [0300] In the retransmission queue management 
unit 12, the transmission order is set for these retrans- 
mission packets, and these packets are retransmitted to 
the receiving end through the transmission unit 13. 
Since the retransmission packets (S+1) and (S+2) are 

w high priority packets, when transmitting these packets, 
the values of their transmitting end high priority 
sequence numbers stored in the high priority sequence 
number management unit 81 are incremented. 
[0301 ] To be specific, when transmitting the retrans- 

15 mission packet (S+1), the value of the transmitting end 
high priority sequence number [H+3] stored in the high 
priority sequence number management unit 81 is incre- 
mented to "H+4", and the sequence number [S+1] of the 
retransmission packet (S+1) and the transmitting end 

20 high priority sequence number [H+4] are entered, by 
one-to-one correspondence, in the sequence number 
correspondence management unit 82. 
[0302] Further, when transmitting the retransmis- 
sion packet (S+2), the value of the transmitting end high 

25 priority sequence number [H+4] stored in the high prior- 
ity sequence number management unit 81 is incre- 
mented to "H+5". and the sequence number [S+2] of the 
retransmission packet (S+2) and the transmitting end 
high priority sequence number [H+5] are entered, by 

30 one-to-one correspondence, in the sequence number 
correspondence management unit 82. 
[0303] As described above, according to the ninth 
embodiment of the invention, data transmission from 
the transmitting end to the receiving end is continuously 

35 performed in units of packets, each packet having addi- 
tional information relating to its sequence number, prior- 
ity, and data reproduction time, and information relating 
to the high priority sequence number managed at the 
transmitting end and, simultaneously, data of received 

40 packets are successively reproduced at the receiving 
end. The value of the transmitting end high priority 
sequence number possessed by the received packet 
(number of transmitted high priority packets) is com- 
pared with the value of the receiving end high priority 

45 sequence number managed at the receiving end 
(number of received high priority packets), and a 
retransmission request is made by indicating a transmit- 
ting end high priority sequence number which is absent. 
Therefore, the transmission quality of the ratio section in 

so real-time transmission can be improved by retransmis- 
sion of error packets the priorities of which are equal to 
or higher than a predetermined value and, moreover, 
the retransmission of error packets can be realized by 
simpler procedures. 

55 [0304] In this ninth embodiment, when the high pri- 
ority sequence numbers corresponding to plural high 
priority packets transmitted are continuously absent, the 
receiving end sends a retransmission request for each 
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high priority packet having the absent high priority 
sequence number, to the transmitting end. However, 
retransmission requests for plural high priority packets 
may be sent collectively to the transmitting end, by list- 
ing the values of the plural high priority sequence num- 
bers or indicating the range ol these values. 
[0305] In this case, at the transmitting end, based 
on the plural high priority sequence numbers requested 
from the receiving end, the sequence numbers corre- 
sponding to the respective transmitting end high priority 
packets are obtained by retrieval, and the high priority 
packets having the sequence numbers so obtained are 
retransmitted to the receiving end. 

[Embodiment 10] 

[0306] In a data transmission method according to 
a tenth embodiment of the present invention, the 
number of times of retransmission requests to the trans- 
mitting end and the interval of the retransmission 
requests are changed according to the transmission 
status of the radio section, whereby the probability of 
normal transmission of the retransmission requests to 
the transmitting end is increased to improve the trans- 
mission quality in the radio section. 
[0307] Figure 32 is a block diagram illustrating a 
data transmission apparatus 1 10 in a data transmission 
system performing real-time data transmission accord- 
ing to the data transmission method of this tenth 
embodiment. 

[0308] The data transmission apparatus 110 
includes a retransmission decision unit 16d, instead of 
the retransmission decision unit 16c of the data trans- 
mission apparatus 109 of the ninth embodiment. The 
retransmission decision unit 16d performs the same 
process as that of the decision unit 1 6c and, further, out- 
puts the sequence number of the packet which is 
decided to be transmitted. Further, the data transmis- 
sion apparatus 110 includes a sequence number corre- 
spondence management unit 82a, instead of the 
sequence number correspondence management unit 
82 of the data transmission apparatus 109. The 
sequence number correspondence management unit 
82a performs the same process as that of the unit 82 
and, further, deletes the value of the transmitting end 
high priority sequence number corresponding to the 
value of the sequence number supplied from the 
retransmission decision unit 16d. Other constitutes of 
the data transmission apparatus 110 of this tenth 
embodiment are identical to those of the data transmis- 
sion apparatus 109 of the ninth embodiment. 
[0309] Figure 33 is a block diagram illustrating a 
data receiving apparatus 210 in the data transmission 
system performing real-time data transmission accord- 
ing to the data transmission method of this tenth 
embodiment. 

[0310] The data receiving apparatus 210 includes 
an error packet detection unit 22b, instead of the error 



packet detection unit 22a of the data receiving appara- 
tus 209 of the ninth embodiment. The error packet 
detection unit 22b performs the same process as that of 
the unit 22a and, further, decides the transmission sta- 
5 tus of the radio section, from the number of the detected 
error packets. 

[0311] Further, the data receiving apparatus 210 
includes a retransmission instruction output unit 26d, 
instead of the retransmission instruction output unit 26c 

?o of the data receiving apparatus 209. The retransmission 
instruction output unit 26d performs the same process 
as that of the unit 26c and, further, outputs the transmit- 
ted retransmission request as a control signal. 
[0312] Further, the data receiving apparatus 210 

75 includes a retransmission instruction consecutive out- 
put unit 93 which receives the control signal (retrans- 
mission request) output from the retransmission 
instruction output unit 26d, and consecutively outputs 
the retransmission request by a predetermined number 

20 of times at predetermined intervals. Further, the unit 93 
changes the number of output times of retransmission 
request and the output interval, according to information 
indicating the transmission status of the radio section, 
which is output from the error packet detection unit 22b. 

25 [0313] Other constituents of the data receiving 
apparatus 210 of this tenth embodiment are identical to 
those of the data receiving apparatus 209 of the ninth 
embodiment. 

[0314] Next, the function and effect will be 

30 described. 

[0315] Since the fundamental data transmission 
process according to the data transmission method of 
this tenth embodiment is identical to that of the ninth 
embodiment, only a distinctive process of this tenth 

35 embodiment will be described hereinafter. 

[0316] In this tenth embodiment, the packet from 
the transmitting end is received by the receiving unit 21 
and output to the error packet detection unit 22b. In the 
error packet detection unit 22b, the transmission status 

40 of the radio section is detected according to the output 
of the receiving unit 21, and information indicating the 
transmission status of the radio section is supplied to 
the retransmission instruction consecutive output unit 
93. 

45 [0317] On the other hand, when the high priority 
sequence number output from the retransmission 
sequence output unit 92 is input to the retransmission 
instruction output unit 26b, a retransmission request 
indicating the high priority sequence number is output 

so from the retransmission instruction output unit 26b to 
the transmitting end and, simultaneously, this retrans- 
mission request is output as a control signal to the 
retransmission instruction consecutive output unit 93. 
[0318] Then, the retransmission instruction consec- 

55 utive output unit 93 performs a consecutive retransmis- 
sion process for consecutively transmitting the 
retransmission request by several times. In this consec- 
utive retransmission process, the number of transmis- 
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sion times of the retransmission request and the 
transmission interval are adjusted on the basis ot a pre- 
determined value, according to the transmission status 
of the radio section which is obtained from the output 
information of the error packet detection unit 22b. 
[0319] For example, when many transmission 
errors occur in the radio section, the number of request 
transmission times is increased and the output interval 
is increased. Thereby, the probability of normal trans- 
mission of the retransmission request to the transmitting 
end increases. On the other hand, when not many 
transmission errors occur in the radio section, the 
number of request transmission times is decreased, 
and the output interval is narrowed. Thereby the time 
required for retransmission is reduced. 
[0320] Further, at the transmitting end, packet 
retransmission is carried out according to the retrans- 
mission request, and the sequence number corre- 
spondence management unit 82a deletes the value of 
the transmitting end high priority sequence number cor- 
responding to the sequence number supplied from the 
retransmission decision unit 16d. 
[0321 ] Therefore, with respect to the same retrans- 
mission request which is received again, retrieval for the 
sequence number corresponding to this retransmission 
request by the retransmission decision unit 16d ends in 
failure because the correspondence between the trans- 
mitting end high priority sequence number indicated by 
this retransmission request and the sequence number 
is deleted from the sequence number correspondence 
management unit 82a. 

[0322] As the result, in the retransmission decision 
unit 16d. it is decided that no retransmission is per- 
formed for the high priority packet for which the retrans- 
mission request has been made by indicating the value 
of the transmitting end high priority sequence number. 
Therefore, at the transmitting end, it is avoided that the 
same packet is repeatedly retransmitted when the same 
retransmission request is output several times from the 
receiving end. 

[0323] As described above, according to the tenth 
embodiment of the present invention, a retransmission 
request indicating the high priority sequence number of 
a desired packet is consecutively transmitted several 
times, from the receiving end to the transmitting end, 
against transmission errors. Therefore, when at least 
one of the several transmission requests from the 
receiving end is normally received at the transmitting 
end, the error packet the priority of which is equal to or 
higher than a predetermined value can be retransmit- 
ted, whereby the transmission quality in the radio sec- 
tion in real-time transmission can be effectively 
improved 

[0324] Hereinafter, a description will be given of the 
data structure of a packet Pa for transmitting data by a 
data transmitting method according to any of the afore- 
mentioned embodiments. 

[0325] Figures 34(a) -34(c) are diagrams illustrating 



the data structure of the packet Pa. 
[0326] This packet Pa is composed of a header sec- 
tion Ph which contains relevant intonation indicating the 
attribute of the packet, and a data section Pd which 

5 stores data to be transmitted (figure 34(a)). 

[03271 The header section Ph includes header into- 
nation la indicating the sequence number correspond- 
ing to each packet, header information lb indicating the 
reproduction time at the receiving end, of the data to be 

70 transmitted (time stamp) lb, header information indicat- 
ing the priority of each packet, extension header infor- 
mation Id, and other header information II to 110 (refer 
to figure 34(b)). 

[0328] The specific convention of each header 

is information is described in RFC 1889 as shown in figure 
34(c). For example, the header information 1 3 indicates 
that the extension header information Id is added to the 
header section Ph when its value X is 1. The header 
information 15 indicates that the data stored in the data 

20 section is coded data by the MPEG1 method when its 
value PT is 32, and indicates that the data stored in the 
data section is coded data by the MPEG2 method when 
PT is 33. Further, each of the header information 19, Ic, 
110, and 11 1 is header information to be added when the 

25 MPEG1 coded data is transmitted by RTP The value P 
(P=1) of the header information Ic indicates that the 
data in the data section is I frame data, and the packet 
containing this I frame data is to be treated as a high pri- 
ority packet. The value P (P=2) indicates that the data in 

30 the data section is P frame data, and the packet contain- 
ing this P frame data is to be treated as a low priority 
packet. The value P(P=3) indicates that the data in the 
data section is B frame data, and the packet containing 
this B frame data is to be treated as a low priority 

35 packet. 

[0329] Further, the extension header information Id 
corresponds to the sequence number and the priority 
information of the previous packet in the third embodi- 
ment (refer to figure 6), the sequence number and the 

40 retransmission count of the previously transmitted high 
priority packet in the fourth embodiment (refer to figures 
13 and 14), the sequence number and the reproduction 
time of the previous packet in the second modification of 
the sixth embodiment (refer to figure 21), the difference 

45 value of the sequence number of the previous packet 
and the difference value of the reproduction time of the 
previous packet in the third modification of the sixth 
embodiment (refer to figure 22), and the transmitting 
end high priority sequence number in the ninth embodi- 

so ment (refer to figure 29). 

Claims 

1 . A data transmission method for performing continu- 
55 ous data transmission from the transmitting end to 
the receiving end in units of packets, each packet 
having additional information relating to its 
sequence number, priority, and data reproduction 
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time at the receiving end, while successively repro- 
ducing data of packets received at the receiving 
end, said method comprising the steps of: 

at the transmitting end, 5 

giving priority information to each packet to 
be transmitted; and 

storing, as retransmission data, only data 
of packets the priorities of which are equal w 
to or higher than a predetermined value, in 
a retransmission buffer; 

at the receiving end, 

15 

when a transmission error is detected, 
detecting the priority information of an 
error packet; and 

when the detected priority is equal to or 
higher than the predetermined value, out- 20 
putting a retransmission request for the 
error packet to the transmitting end by indi- 
cating the sequence number of this error 
packet; 

25 

at the transmitting end, 

only when the data of the packet having 
the sequence number which is indicated 
by the retransmission request from the 30 
receiving end is stored in the retransmis- 
sion buffer, retransmitting the data of this 
packet to the receiving end; and 
discarding the data stored in the retrans- 
mission buffer in order starting from a 35 
packet which cannot be in time for data 
reproduction at the receiving end. 

2. The data transmission method of Claim 1 wherein, 
when the retransmission buffer is filled up to its 40 
capacity, an updation process is performed, in 
which the retransmission data are retained while 
the data stored in the retransmission buffer are dis- 
carded in order, starting from a packet of the earli- 
est reproduction time, on the basis of the 45 
reproduction time of each packet stored in the 
retransmission buffer. 

3. The data transmission method of Claim 1 wherein, 
when the data transmitted from the transmitting end 50 
to the receiving end is video data based on MPEG. 

a packet which contains data corresponding to 
frames coded by utilizing tntra-frame correlation is 
regarded as a packet having a high priority. 

55 

4. The data transmission method of Claim 1 wherein: 

at the transmitting end, the additional informa- 



tion relating to the sequence number and the 
priority of a predetermined packet is also 
embedded in a subsequent packet to be trans- 
mitted after the predetermined packet; and 
at the receiving end, in the case where a trans- 
mission error has occurred in the predeter- 
mined packet and the additional intonation of 
the predetermined packet has an error, a 
retransmission request for the predetermined 
packet as an error packet is made on the basis 
of the additional information of the predeter- 
mined packet which is embedded in the subse- 
quent packet, when the subsequent packet 
transmitted after the predetermined packet is 
received. 

5. The data transmission method of Claim 4 wherein: 

at the transmitting end, the process of embed- 
ding the sequence number of a predetermined 
high priority packet in a subsequent packet 
which follows the predetermined high priority 
packet is continuously performed until a high 
priority packet next to the predetermined high 
priority packet is transmitted; and 
at the receiving end, the sequence number of 
another packet which is embedded in the 
received packet is extracted, and when a trans- 
mission error has occurred in the packet of the 
extracted sequence number, a retransmission 
request for this error packet is made by indicat- 
ing the sequence number of this packet. 

6. A data transmission apparatus for relaying data 
which are successively transmitted from the trans- 
mitting end in units of packets, each packet having 
additional information relating to its sequence 
number, priority, and data reproduction time at the 
receiving end, said apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 
a priority decision unit for deciding the priority 
of each of the received packets; 
a retransmission packet storage unit for storing 
packets the priorities of which are equal to or 
higher than a predetermined value, as retrans- 
mission packets, on the basis of the priority of 
each packet decided by the priority decision 
unit; 

a retransmission instruction receiving unit for 
receiving a retransmission request from a ter- 
minal at the receiving end; 
a retransmission decision unit for deciding 
whether retransmission of the packet for which 
the retransmission request has been made 
should be performed or not, on the basis of the 
retransmission request and the storage status 
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of the retransmission packets in the retransmis- 
sion packet storage unit; 
a transmission queue management unit for set- 
ting the transmission order of the received 
packets and the packets which have been s 
decided as packets to be retransmitted, on the 
basis of the additional information; and 
a transmission unit for transmitting the data of 
these packets in the transmission order set by 
the management unit. w 

7. A data receiving apparatus for receiving data which 
are transmitted from the transmitting end in units of 
packets, each packet having additional information 
relating to its sequence number, priority, and data 15 
reproduction time at the receiving end, and succes- 
sively reproducing the data for each packet, said 
apparatus comprising: 



to or higher than a predetermined value, in 
a retransmission buffer; 

at the receiving end, 

when a transmission error is detected, 
detecting the reproduction time for an error 
packet and the arrival time of the error 
packet, and deciding an arrival time limit in 
accordance with the reproduction time; 
and 

when the error packet has arrived before 
the arrival time limit, outputting a retrans- 
mission request for the error packet to the 
transmitting end by indicating the 
sequence number of this error packet; 

at the transmitting end, 



a receiving unit for receiving the packets trans- 20 
mitted from the transmitting end; 
an error packet detection unit for detecting 
error packets in which errors have occurred 
during transmission, and outputting normal 
packets which have been transmitted without 2s 
transmission errors, on the basis of the data of 
the received packets; 

a packet priority decision unit for receiving the 
output from the error packet detection unit, and 
deciding error packets the priorities of which 30 
are equal to or higher than a predetermined 
value; and 

a retransmission instruction output unit for out- 
putting a retransmission request for each of the 
error packets the priorities of which are decided 35 
as being equal to or higher than the predeter- 
mined value, to the transmitting end, by indicat- 
ing the sequence number of this error packet. 

8. A data transmission method in which data transmis- 40 
sion from the transmitting end to the receiving end 
is continuously performed in units of packets, each 
packet having additional information relating to its 
sequence number, priority, and data reproduction 
time at the receiving end, while successively repro- 45 
ducing data of packets which have arrived at the 
receiving end and, at this time, only packets which 
can be in time for data reproduction at the receiving 
end are retransmitted, said method comprising the 
steps of: so 

at the transmitting end, 



when the data of the packet having the 
sequence number indicated by the retrans- 
mission request from the receiving end is 
stored in the retransmission buffer, retrans- 
mitting data of the packet the transmission 
time of which does not pass the reproduc- 
tion time, to the receiving end, while dis- 
carding data of the packet the transmission 
time of which has passed the reproduction 
time; and 

discarding the data stored in the retrans- 
mission buffer in order starting from a 
packet which cannot be in time for data 
reproduction at the receiving end. 

9. The data transmission method of Claim 8 wherein, 
when the retransmission buffer is filled up to its 
capacity, an updation process is performed, in 
which the retransmission data are retained while 
the data stored in the retransmission buffer are dis- 
carded in order, starting from a packet of the earli- 
est reproduction time, on the basis of the 
reproduction time of each packet stored in the 
retransmission butter. 

10. The data transmission method of Claim 8 wherein 
the arrival time limit is decided based on at least 
one of the allowable packet delay time decided at 
the receiving end, and the packet transmission 
delay time between the transmitting end and the 
receiving end. 

11. The data transmission method of Claim 8 wherein: 



giving a data reproduction time at the 
receiving end to each packet to be trans- 55 
mitted; and 

storing, as retransmission data, only data 
of packets the priorities of which are equal 



at the transmitting end. additional information 
relating to the sequence number and the repro- 
duction time corresponding to a target packet 
to be transmitted is embedded in a subsequent 
packet to be transmitted after the target packet; 
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and 

at the receiving end, when a transmission error 
of the target packet has occurred and the addi- 
tional information of the target packet has an 
error, a retransmission request for the target s 
packet as an error packet is made on the basis 
of the additional information of the target 
packet which is embedded in the subsequent 
packet, when the subsequent packet transmit- 
ted after the target packet is received. io 

12, A data transmission apparatus for relaying data 
which are successively transmitted from the trans- 
mitting end in units of packets, each packet having 
additional information relating to its sequence 15 
number, priority, data reproduction time at the 
receiving end, said apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 20 
a priority decision unit for deciding the priority 
of each of the received packets; 
a reproduction time decision unit for deciding 
packets which cannot be in time for reproduc- 
tion at the receiving end, amongst the packets 25 
to be transmitted to the receiving end; 
a retransmission packet storage unit for storing 
packets the priorities of which are equal to or 
higher than a predetermined value, as retrans- 
mission packets, on the basis of the priority of 30 
each packet decided by the priority decision 
unit; 

a retransmission instruction receiving unit for 
receiving a retransmission request from a ter- 
minal at the receiving end; 35 
a retransmission decision unit for deciding 
whether retransmission of the packet for which 
the retransmission request has been made 
should be performed or not, on the basis ol the 
retransmission request and the storage status 40 
of the retransmission packets in the retransmis- 
sion packet storage unit; 
a transmission queue management unit for set- 
ting the transmission order of the received 
packets and the packets which have been 45 
decided as packets to be retransmitted, on the 
basis of the additional information; and 
a transmission unit for transmitting, in the trans- 
mission order set by the management unit, the 
data of packets other than the packets which so 
are decided as packets that cannot be in time 
for reproduction at the receiving end, by the 
reproduction time decision unit. 

1 3. A data receiving apparatus for receiving data which 55 
are transmitted from the transmitting end in units of 
packets, each packet having additional information 
relating to its sequence number, priority, and data 



reproduction time at the receiving end, and succes- 
sively reproducing the data for each packet, said 
apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 
an error packet detection unit for detecting 
error packets in which errors have occurred 
during transmission, and outputting normal 
packets which have been transmitted without 
transmission errors, on the basis of the data of 
the received packets; 

a reproduction time decision unit for detecting 
the reproduction time given to each error 
packet detected by the error packet detection 
unit and the arrival time of the error packet at 
the receiving end, and setting the arrival time 
limit based on the reproduction time, and 
deciding whether or not the error packet has 
arrived at the receiving end before the arrival 
time limit; and 

a retransmission instruction output unit for out- 
putting a retransmission request only for the 
error packet which has arrived at the receiving 
end before the arrival time limit, to the transmit- 
ting end, by indicating the sequence number of 
the error packet, on the basis of the result of 
the decision in the reproduction time decision 
unit. 

14. A data transmission method for performing continu- 
ous data transmission from the transmitting end to 
the receiving end in units of packets, each packet 
having additional information relating to its 
sequence number, priority, and data reproduction 
time at the receiving end, while successively repro- 
ducing data of packets arrived at the receiving end, 
said method comprising the steps of: 

at the transmitting end. 

giving a data reproduction time and priority 
information to each packet to be transmit- 
ted; and 

storing, as retransmission data, only data 
of packets the priorities of which are equal 
to or higher than a predetermined value, in 
a retransmission buffer; 

at the receiving end. 

when a transmission error is detected, 
detecting the priority information of an 
error packet, the reproduction time of the 
error packet, and the arrival time of the 
error packet; 

setting the arrival time limit of the error 
packet on the basis of the reproduction 
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time; and 

when the detected priority is equal to or 
higher than the predetermined value and 
the error packet has arrived before the 
arrival time limit, outpirtting a retransmis- 5 17. 
sion request for this error packet to the 
transmitting end by indicating the 
sequence number of this error packet; 

at the transmitting end, io 

when data of the packet having the 
sequence number indicated by the retrans- 
mission request from the receiving end is 
stored in the retransmission buffer, retrans- 15 
mitting only data of the packet the trans- 
mission time of which does not pass the 
reproduction time, to the receiving end, 18. 
while discarding data of the packet the 
transmission time of which has passed the 20 
reproduction time; and 
discarding the data stored in the retrans- 
mission buffer in order starting from a 
packet which cannot be in time for repro- 
duction at the receiving end. 25 

1 5. The data transmission method of Claim 1 4 wherein : 

at the transmitting end, additional information 
relating to the sequence number, the priority, 30 
and the reproduction time of a predetermined 
packet is embedded in a subsequent packet to 
be transmitted after the predetermined packet; 
and 

at the receiving end. when a transmission error 35 
of the predetermined packet has occurred and 
the additional information of the predetermined 
packet has an error, a retransmission request 19. 
for the predetermined packet as an error 
packet is made on the basis of the additional 40 
information of the predetermined packet which 
is embedded in the subsequent packet, when 
the subsequent packet transmitted after the 
predetermined packet is received. 

45 

1 6. The data transmission method of Claim 1 5 wherein: 20. 

at the transmitting end, the process of embed- 
ding the sequence number of a predetermined 
high priority packet in a subsequent packet so 
which follows the predetermined high priority 
packet is continuously performed until a high 
priority packet next to the predetermined high 
priority packet is transmitted; and 
at the receiving end. the sequence number of 55 
another packet which is embedded in the 
received packet is extracted, and when a trans- 
mission error has occurred in the packet of the 



extracted sequence number, a retransmission 
request for this packet is made by indicating the 
sequence number of this packet. 

The data transmission method of Claim 15 wherein, 
at the transmitting end, when additional information 
relating to the sequence number and the reproduc- 
tion time corresponding to each packet is embed- 
ded in a subsequent packet to be transmitted after 
the packet, a difference between additional infor- 
mation relating to the sequence number and the 
reproduction time corresponding to the subsequent 
packet and the additional information relating to the 
sequence number and the reproduction time corre- 
sponding to the previous packet is embedded as 
the additional information. 

A data transmission method for performing data 
transmission between a distribution server and a 
terminal through a relay server in units of packets, 
and successively reproducing data of packets 
received at the terminal, said method comprising 
the steps of: 

when a transmission error has occurred 
between the relay server and the terminal, per- 
forming retransmission of an error packet by 
the relay server in response to a retransmis- 
sion request from the terminal; and 
when a transmission error has occurred 
between the distribution server and the relay 
server, performing retransmission of an error 
packet by the distribution server in response to 
a retransmission request which has been 
transmitted from the terminal through the relay 



The data transmission method of Claim 18 wherein, 
when a transmission error has occurred between 
the distribution server and the relay server, a 
retransmission request is transmitted from the relay 
server to the distribution server, and retransmission 
of an error packet to the relay server is performed 
by the distribution server. 

A data transmission apparatus for relaying data 
which are successively transmitted from a distribu- 
tion server, in units of packets each having addi- 
tional information relating to its sequence number, 
priority, data reproduction time at the receiving end, 
said apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 
a priority decision unit for deciding the priority 
of each of the received packets; 
a retransmission packet storage unit for storing 
packets the priorities of which are equal to or 
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at the receiving end, 

extracting the value of the transmitting end 
high priority sequence number which is 

5 embedded in the received packet; 

managing the value of the receiving end 
high priority sequence number which cor- 
responds to the number of received high 
priority packets; 

io when the value of the extracted transmit- 

ting end high priority sequence number is 
not equal to the value of the receiving end 
high priority sequence number, outputting 
a retransmission request to the transmit- 

15 ting end, by indicating the value of the 

transmitting end high priority sequence 
number which is obtained on the basis of 
the value of the receiving end high priority 
sequence number; and 

20 updating the value of the receiving end 

high priority sequence number; 

at the transmitting end, 

25 only when data of the packet having the 



higher than a predetermined value, as retrans- 
mission packets, on the basis of the priority of 
each packet decided by the priority decision 
unit; 

a retransmission instruction receiving unit for 
receiving a retransmission request from a ter- 
minal at the receiving end; 
a retransmission decision unit for deciding 
whether retransmission of the packet for which 
the retransmission request has been made is 
to be performed or not, on the basis of the 
retransmission request and the storage status 
of the retransmission packets in the retransmis- 
sion packet storage unit; 
a retransmission instruction output unit for out- 
putting the retransmission request for the error 
packet requested by the terminal, to the distri- 
bution server, on the basis of the result of the 
decision in the retransmission decision unit; 
a transmission queue management unit for set 
ting the transmission order of the received 
packets and the packets which have been 
decided as packets to be retransmitted, on the 
basis of the additional information; and 
a transmission unit for transmitting the data of 
these packets in the transmission order set by 
the management unit. 



21 . A data transmission method for performing continu- 
ous data transmission from the transmitting end to 30 
the receiving end in units of packets, each packet 
having additional information relating to its 
sequence number, priority, and data reproduction 
time at the receiving end, while successively repro- 
ducing data of packets received at the receiving 35 
end, said method comprising the steps of: 

at the transmitting end, 



sequence number corresponding to the 
value of the transmitting end high priority 
sequence number which is indicated by 
the retransmission request from the receiv- 
ing end is stored in the retransmission 
buffer, retransmitting the data of this 
packet to the receiving end. 

22. The data transmission method of Claim 21 wherein: 

at the receiving end, when the value of the 
transmitting end high priority sequence number 
embedded in the received packet is not equal 
to the value of the receiving end high priority 
sequence number, a retransmission request is 
output to the transmitting end, by listing the val- 
ues ranging from the value obtained by adding 
1 to the receiving end high priority sequence 
number, to the value of the transmitting end 
high priority sequence number, as the values of 
the transmitting end high priority sequence 
numbers, or by designating the range as the 
range of the values of the transmitting end high 
priority sequence numbers; and 
at the transmitting end, the sequence numbers 
corresponding to the values of the plural trans- 
mitting end high priority sequence numbers 
which are indicated by the retransmission 
request from the receiving end are retrieved, 
and only when data of the packets having the 
sequence numbers obtained by the retrieval 
are stored in the retransmission buffer, the data 
of the packets are retransmitted to the receiv- 



when a packet the priority of which is equal 40 
to or higher than a predetermined value is 
transmitted as a high priority packet, stor- 
ing data of this high priority packet, as 
retransmission data, in a retransmission 
buffer; 45 
managing the value of the transmitting end 
high priority sequence number which cor- 
responds to the number of transmitted high 
priority packets, and the value of the 
sequence number of the high priority so 
packet so that these values are correlated 
with each other; and 

transmitting a subsequent packet which 
follows the high priority packet after 
embedding the value of the transmitting 55 
end high priority sequence number in this 
subsequent packet; 
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ing end. 

23. The data transmission method of Claim 21 wherein: 

at the receiving end, the retransmission 5 
request is performed continuously be several 
times, indicating the value of a transmitting end 
high priority sequence number; and 
at the transmitting end, the sequence number 
corresponding to the value of the transmitting 10 
end high priority sequence number which is 
indicated by the retransmission request from 
the receiving end is retrieved, and data of the 
packet having the sequence number obtained 
by the retrieval is retransmitted to the receiving is 
end and, simultaneously, the correspondence 
between the value of the sequence number 
obtained by the retrieval and the value of the 
transmitting end high priority sequence number 
indicated by the receiving end is deleted. 20 

24. A data transmission apparatus for relaying data 
which are successively transmitted from the trans- 
mitting end in units of packets, each packet having 
additional information relating to its sequence 25 
number, priority, data reproduction time at the 
receiving end. said apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 30 
a transmission queue management unit for set- 
ting the transmission order of the received 
packets and packets which are decided as 
packets to be retransmitted; 
a transmission unit for transmitting data of 35 
these packets in the transmission order set by 
the transmission queue management unit; 
a priority decision unit for deciding the priority 
of each of the received packets; 
a retransmission packet storage unit for storing 40 
packets the priorities of which are equal to or 
higher than a predetermined value, as retrans- 
mission packets, on the basis of the priority of 
each packet decided by the priority decision 
unit; 45 
a sequence number management unit for man- 
aging the value of the transmitting end high pri- 
ority sequence number which corresponds to 
the number of transmitted high priority packets, 
and the value of the sequence number of the so 
high priority packet so that these values are 
correlated with each other; 
a high priority sequence number insertion unit 
for embedding the value of the transmitting end 
high priority sequence number in a subsequent 55 
packet which follows the high priority packet; 
a retransmission instruction receiving unit for 
receiving a retransmission request indicating 



the high priority sequence number, from a ter- 
minal at the transmitting end; and 
a retransmission decision unit for deciding 
whether retransmission of the packet for which 
the retransmission request has been made is 
to be performed or not, on the basis of the 
retransmission request and the storage status 
of the retransmission packets in the retransmis- 
sion packet storage unit. 

25. A data receiving apparatus for receiving data which 
are transmitted from the transmitting end in units of 
packets, each packet having additional intonation 
relating to its sequence number, priority, and data 
reproduction time at the receiving end, and succes- 
sively reproducing the data for each packet, said 
apparatus comprising: 

a receiving unit for receiving the packets trans- 
mitted from the transmitting end; 
an error packet detection unit for detecting an 
error packet in which an error has occurred 
during transmission, and outputting a normal 
packet which has been transmitted without 
transmission errors, and the value of the trans- 
mitting end high priority sequence number 
which corresponds to the number of transmit- 
ted high priority packets and is embedded in 
the normal packet; 
- a high priority sequence number management 
unit for managing the value of the receiving end 
high priority sequence number which corre- 
sponds to the number of normal high priority 
packets which have been received without 
transmission errors, on the basis of the output 
from the error packet detection unit; 
a retransmission sequence number decision 
unit for comparing the value of the transmitting 
end high priority sequence number from the 
error packet detection unit with the value of the 
receiving end high priority sequence number, 
and when these values are not equal, deciding 
the value of the transmitting end high priority 
sequence number for which a retransmission 
request is to be made, on the basis of the value 
of the receiving end high priority sequence 
number; and 

a retransmission instruction output unit for out- 
putting a retransmission request to the trans- 
mitting end, by indicating the value of the 
decided transmitting end high priority 
sequence number. 

26. A data structure of a packet for performing data 
transmission from the transmitting end and the 
receiving end, wherein: 

said packet comprises a header section con- 
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taining relevant information indicating the 
attribute of the packet, and a data section con- 
taining data to be transmitted; and 
said header section comprises at least first and 
second header information, amongst first 5 
header information indicating the sequence 
number corresponding to the packet, second 
header information indicating the priority of the 
packet, and third header information indicating 
the reproduction time at the receiving end, of w 
the data to be transmitted. 



27. The packet data structure ol Claim 26 wherein the 
header section of the packet includes attribute infor- 
mation of a packet which has already been trans- 15 
mitted before the packet. 

28. The packet data structure of Claim 27 wherein the 
header section of the packet includes the first and 
second information or the first and third information, 20 
as attribute information of a packet which has 
already been transmitted before the packet. 



29. The packet data structure of Claim 26 wherein the 
header section of the packet includes the value of 25 
the high priority sequence number corresponding 
to the number of high priority packets which have 
been transmitted before the packet and having the 
priorities equal to or higher than a predetermined 
value. 30 
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